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FOREWORD 


This  final  report  describes  work  performed  by  ARINC  Research 
Corporation  between  15  August  1977  emd  15  February  1978  for  the 
U.S.  Air  Force  LogiSCIcs  Comm2md  under  Contract  FO9b03-77-A-3104. 


We  are  indebted  to  Mr.  John  Max  of  the  AFLC/LOM  and  Mr. 

David  Hannon,  Warranty  Program  Manager  - Collins  Avionics  Group 
for  their  assist^mce  during  the  contract  effort.  We  are  also 
indebted  to  the  many  civiliein  and  military  personnel  at  each  of  the 
U.S.  Air  Force  Bases  visited  who  made  the  data  collection  possible. 


The  cooperation,  imagination  and  initiative  displayed  by 
these  people  greatly  enhanced  our  ability  to  perform  the  contract 
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ABSTRACT 


\ 

ARINC  Research  Corporation  conducted  a six -month  study  to 
investigate  the  validity  of  contractual  techniques  for  calculating 
warranty  statistics  for  the  AN/ARN-118 (V)  TACAN.  TACAN  field  data 
were  collected  from  eleven  U.S.  Air  Force  Bases  by  ARINC  Research. 
Additional  TACAN  data  submitted  by  the  Air  Force  were  used  in  support 
of  this  study.  Average  Operating  Time  (AOT) , Total  Operating  Hours 
(TOH) , and  Mean  Time  Between  Failures  (MTBF)  based  on  these  field  data 
were  compared  with  the  values  of  these  parcimeters  calculated  by 
contractual  methods.  No  significant  differences  between  field  data 
estimates  and  the  contractual-methods  of  calculation  were  identified. 
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SUMMARY 


ARINC  Research  Corporation  assessed  the  adequacy  of  the  methods 
for  computing  warranty  statistics  for  the  AN/AKN-118 (V)  TACAN  as  set 
forth  in  the  RIW  and  MTBF  Guarantee  terms  and  conditions  of  Contract 
F19628-76-C-0144.  The  work  was  performed  for  the  USAF  Logistics 
Command,  AFLC/LOM,  under  Contract  F09603-77-A-3104 . 

The  company  performed  five  contract  tasks.  During  Task  1,  a 
plan  for  data  collection  and  evaluation  was  developed  to  identify  the 
data  to  be  acquired  and  addressed  how  these  data  would  be  analyzed. 

In  Tasks  2 and  3 data  were  obtained  from  both  Air  Force  Bases  and  the 
TACAN  mcinufacturer,  Collins  Avionics  Group,  Rockwell  International 
Corporation,  Cedar  Rapids,  Iowa.  Tasks  4 and  5 consisted  of  evalu- 
ating the  acquired  data  and  developing  suggested  changes  to  the  cur- 
rent methods  of  computing  warranty  statistics. 

The  following  conclusions  were  drawn  from  this  study; 

. The  computational  methods  outlined  in  the  AN/ARN-118 (V) 

RIW  and  MTBF  Guarantee  terms  and  conditions  of  Contract 
F19628-76-C-0144  are  adequate  for  estimating  field 
performance.  The  set  MTBFs  obtained  with  both  the  contractual 
and  field  computations  are  excellent;  current  estimates 
indicate  that  they  exceed  ultimate  performance  goals. 

. There  is  evidence  that  the  need  for  accurate  data  record- 
ing on  the  R/T  record  card  is  not  fully  understood  by 
AFB  personnel. 

. The  contractual  method  of  estimating  average  operating  time 
(AOT)  is  adequate  for  assessing  field  experience.  The 
AOT  differential  between  field  readings  and  contractual 
computation  was  6 percent. 

. The  contractual  m thod  of  estimating  total  operating  hours 
(TOH)  is  adequate  for  assessing  field  experience.  A 
difference  of  12  percent  between  contractual  and  field 
computational  approaches  was  observed. 

. During  the  TACAN  build-up  phase,  the  accuracy  of  the  TOH 
estimate  could  be  increased  by  using  an  improved  technique 
for  estimating  N,  the  average  number  of  installs. 
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. The  contractual  method  of  estimating  MTBF  is  adequate  for 
assessing  field  experience.  A difference  of  12  percent 
between  contractual  and  field  computational  approaches 
was  observed. 

. Large  differences  in  TACAN  MTBF  were  noted  between  aircraft 
types. 

The  following  recommendations  are  presented  on  the  basis  of  the 
field  visits  emd  computational  exercises : 

. The  present  contractual  method  of  computation  is  adequate  for 
estimating  field  performance  and  should  not  be  changed  for 
this  progrcun. 

. An  alternate  (averaging)  approach  for  computing  N (average 
number  of  equipments  installed  over  the  measurement  period) 
should  be  considered  for  use  in  future  RIW  procurements. 

. Each  Air  Force  Base  should  be  given  a presentation  outlining 
the  rationale  and  objectives  of  a warranty  procurement. 
Special  emphasis  should  be  placed  on  the  need  for  accurate 
data  recording. 

. It  was  evident  from  the  field  visits  that  not  all  Air  Force 
Bases  have  adapted  equally  well  to  the  warranty  program. 

Bases  showing  evidence  of  excessive  nonverified  returns 
I and/or  exclusions  and  poor  data  recording  should  be  assisted. 

( This  assistance  could  take  the  form  of  an  educational 

[ presentation  that  would  address  use  of  tests,  specifications, 

I and  equipment,  as  well  as  data  requirements.  This  progrcim 

would  be  similar  to  the  one  noted  in  the  preceding 
recommendations,  except  that  it  would  be  structured  to  help 
only  bases  that  already  have  the  AN/ARN-118 (V) . 

. Careful  consideration  must  be  given  in  predicting  future 
aircraft  mixes  since  achieved  MTBF  differs  significantly 
by  aircraft  type. 
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CHAPTER  ONE 
INTRODUCTION 


1 . 1 BACKGROUND 

The  U.S.  Air  Force  plans  to  procure  approximately  8,000  AN/ARN-118 (V) 
TACAN  sets  through  a basic  buy  and  subsequent  exercise  of  options  from 
the  Collins  Avionics  Group  (CAG) , of  Rockwell  International,  Cedar 
Rapids,  Iowa.  This  procurement,  initiated  in  July  1975,  is  based  on 
a development  program  and  production  phase  that  emphasized  Reliability 
Improvement  Warranty  (RIW)  concepts.  As  a result  of  that  emphasis, 
the  production  contract  contains  extensive  RIW  provisions . Among  the 
salient  features  of  the  RIW  provisions  are  an  agreement  on  guaranteed 
growth  of  mean  time  between  failure  (MTBF)  and  a contractual  price 
adjustment  based  on  operating  hours. 

Measurements  of  MTBF  and  operating  hours  have  been  considered  major 
contractual  issues  by  both  the  Government  and  the  contractor.  On  the 
basis  of  the  achieved  MTBF  and  the  utilization  of  the  TACAN  by  the  Air 
Force,  contractual  price  adjustments  may  be  made  depending  on  the 
variations  from  the  contractually  specified  goals. 

This  investigation  into  the  divergence  of  MTBF  values  and  the 
reading  of  operating  hours  was  precipitated  by  the  results  of  the  TACAN 
lOT&E  exercise  (see  References  1 and  2) . ARINC  Research  monitored  the 
TACAN  during  the  lOTSE  period  and  performed  sample  calculations  of 
both  average  operating  time  (AOT)  and  MTBF.  These  calculations  were 
performed  in  two  ways:  the  first  utilized  elapsed-time-indicator  (ETI) 
readings  of  all  installed  units,  while  the  second  method  used  ETI  readings 
of  the  units  returned  to  Collins.  As  shown  in  the  final  report  of  the 
ARINC  Research  investigation  (Reference  2) , the  contractual  computation 
method,  based  on  the  sample  of  units  (24)  returned  to  Collins,  resulted 
in  a contractually  computed  AOT  higher  than  the  actual  AOT  (2.241)  hours 
per  day  versus  1.651  hours  per  day.  Using  these  two  different  AOT 
figures  in  the  MTBF  computations  resulted  in  a contractually  estimated 
MTBF  41.7  percent  higher  than  the  MTBF  calculated  from  the  field  data 
(771  hours  versus  544  hours) . Our  report  recognized  that  the  sample 
size  of  24  returned  units  was  small  and  anticipated  that  the  contractual 
method  would  provide  a better  indication  of  actual  experience  once  a 
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larger  quantity  of  returns  was  received.  It  was  recommended  that  the 
Air  Force  continue  to  monitor  these  parameters  to  determine  the 
adequacy  of  the  contractual  computations  in  gauging  the  actual  per- 
formamce  being  achieved. 

1.2  STUDY  OBJECTIVES 

The  objectives  of  this  study  are  twofold; 

. Determine  from  field  data  whether  the  contractual 
computational  approaches  for  MTBF,  TOH,  and  AOT 
adequately  estimate  actual  operational  experience. 

. If  a marked  disparity  was  found,  develop  or  suggest 
alternative  computational  methods. 

In  working  to  meet  these  objectives,  the  project  team  was  able 
to  observe  during  the  field  data  collection  visits  other  TACAN 
operations  that  have  some  bearing  on  the  effectiveness  of  the  RIW 
program.  These  observations  are  also  presented  in  this  report. 

1.3  OVERVIEW  OF  WORK  PERFORMED 

The  technical  approach  to  achieving  the  goals  of  this  investi- 
gation consisted  of  six  tasks  as  described  below. 

1.3.1  Task  1;  Develop  a Data  Accumulation  and  Evaluation  Plan 

The  number  of  currently  installed  TACANs  and  the  location  of 
those  TACANS  throughout  the  Air  Force  Bases  were  identified.  Then  a 
plan  of  travel  was  outlined,  eind  a formal  plan  for  data  gathering 
and  evaluation  was  presented  to  the  Air  Force  for  approval. 

1.3.2  Task  2:  Obtain  Data  Needed  to  Determine  the  Actual  Average 
Operating  Time  per  Day  for  the  Operational  Fleet 

Approved  Air  Force  bases  were  visited  for  the  physical  reading 
of  aircraft  TACAN  ETIs,  flying  hours,  and  installation  data.  Every 
effort  was  made  to  obtain  the  required  information  on  as  many  TACANs 
as  possible;  however,  100  percent  readings  were  not  always  possible 
because  of  unavailability  of  aircraft.  In  these  cases,  data  forms 
were  left  with  the  individuals  at  the  Air  Force  Bases  for  completion 
and  return  to  ARINC  Research.  Since  it  was  not  possible  under  the 
contract  to  visit  every  TACAN  base  (of  which  there  were  29) , an  Air 
Force  data-gathering  effort  was  initiated,  with  ARINC  Research  data 
forms  being  distributed  to  the  balance  of  the  bases  by  AFLC  for 
completion  and  return  to  ARINC  Research. 
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. Chapter  Five  presents  the  qualitative  observations  for 
the  AN/ARN-118 (V)  TACAN  program  gathered  during  the 
base  visits. 

. Chapter  Six  presents  an  alternative  technique  for  _ 
computating  the  average  number  of  installs  per  month  (N) . 

. Chapter  Seven  provides  the  conclusions  and  recommendations 
of  this  study  effort. 

The  following  Appendixes  are  also  included; 

Appendix  A - Data  Accumulation  and  Evaluation  Plan 

Appendix  B - Basic  Field  Data  and  Preliminary 

Calculations  Prepared  by  ARINC  Research 

Appendix  C - Basic  Contractor  (Collins  Avionics  Group) 
Data  Collected  by  ARINC  Research 

Appendix  D - Basic  USAF-Submitted  Data  and  Preliminary 
Calculations  Prepared  by  ARINC  Research 


CHAPTER  TWO 


STUDY  APPROACH 


This  investigation  was  approached  in  a manner  that  was  consistent 
with  the  objectives  of  the  contract,  neunely,  to  gather  field  and 
contractor  data,  evalute  these  data,  and,  if  necessary,  develop 
alternative  computational  methods  that  would  more  accurately  estimate 
the  true  MTBF  of  the  TACAM.  The  following  steps  were  taken  to  achieve 
those  goals: 

1.  Determine  the  current  distribution  of  AN/ARN-118 (V) 

TACAN  in  the  USAF  fleet. 

2.  Identify  the  statistical  information  needed  for  a valid 
assessment  of  MTBF  and  AOT,  while  providing  information 
that  might  be  used  in  the  event  alternative  computational 
methods  were  needed. 

3.  Develop  a logical  method  of  analysis  for  all  data  sets. 

4.  Develop  a sampling  plan  to  obtain  the  desired  information, 
with  maximum  coverage  of  aircraft  types  and  deployment 
locations. 

Since  it  was  necessary  to  define  the  individual  actions  as  the 
study  progressed  and  to  explain  the  relationship  between  the  above 
steps,  a Data  Accumulation  and  Evaluation  Plan  was  written.  This 
plan,  reproduced  in  Appendix  A to  this  report,  outlines  the  ARINC 
Research  contractual  efforts.  It  will  be  used  as  a reference  in 
this  report  to  illustrate  the  approach  to  this  study. 

2.1  DETERMINATION  OF  TACAN  DISTRIBUTION  IN  THE  USAF  FLEET 

The  previous  ARINC  Research  experience  with  the  AN/ARN-118 (V) 
TACAN  had  concluded  in  December  1976  with  a final  report  (Reference  2) 
under  a TRACALS  SPO  Contract  F19628-76-C-0053.  This  contractual  effort 
involved  not  only  the  monitoring  of  the  Collins  TACAN  from  a warranty 
viewpoint  but  also  a performance  evaluation  during  the  period  of 
January  through  October  1976.  During  that  period,  approximately  50 
TACANS  were  equally  divided  between  3 bases  and  4 aircraft  types  as 
follows : 
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Air  Force  Base 

Aircraft  Type 

Number  of  TACANs 

» 

• 

Vv- 

1 . 

Rcindolph  AFB,  TX 

T-38 

15 

Castle  AFB,  CA 

B-52/KC-135 

8/7 

Nfl 1 is  AFB,  NV 

F-111 

15 

A*  'In-  t iiiM'  t>f  the  preparation  of  the  final  report,  the  installa- 
tion of  the  TA<  ANr.  hf«<i  to  take  place  at  a much  more  rapid  rate. 

By  March  1977,  there  w«m«  >ix  iw  i*  <•!  y S20  TACANs  installed,  with  ein 

additional  700  sets  delivered  lo  t ti»-  Alt  Ki.roe.  of  these  sets  (units 
provided  under  the  initial  buy  and  tin-  ixe,.  , ..f  the  first  option 

for  additional  units),  the  great  majority  wen-  eitt.et  iwaituKi 
installation  or  being  held  in  bonded  storage  as  spates. 

On  the  basis  of  the  events  of  the  several  previous  months,  a 
significant  increase  in  the  number  of  TACANs  delivered  to  and  installed 
by  the  Government  was  expected.  To  ascertain  the  exact  number  of 
installs  and  deliveries,  ARINC  Research  contacted  AFLC/LOM  for  a 
current  distribution  of  the  AN/ARN-118 (V)  TACANs  in  the  fleet.  Table 
2-1,  which  was  developed  from  information  provided  by  AFLC,  illustrates 
the  known  installs  as  of  2 September  1977.  As  the  table  shows,  some 
1102  TACANs  were  recorded  as  installed  at  that  time  in  8 aircraft  types. 

Table  2-1  provides  and  excellent  starting  point  for  identifying 
the  TACAN  numbers  and  locations.  An  analysis  of  Table  2-1  yielded 
the  following  observations: 

. The  great  majority  of  TACANs  were  on  station  within 

the  CONUS.  The  trainer/fighter-attack  and  heavy  cargo/ 
bomber  aircraft  types  represented  roughtly  a 80/20 
mix,  with  the  former  consisting  mostly  of  T-38s,  and 
the  latter  comprising  of  predominantly  C-130s  and  B-52s. 

. While  the  aircraft  types  were  dispersed  throughout  the 
CONUS,  the  TACAN  population  tended  to  be  concentrated 
at  a few  bases  for  each  aircraft  type.  For  example, 
the  B-52  TACAN  population  was  distributed  over  10  bases, 
with  3 bases  comprising  roughly  50  percent  of  the  fleet. 

The  same  holds  true  for  T-38s  (4  bases  with  71  percent) , 

F-llls  (3  bases  with  99  percent) , and  C-130s  (1  base 
with  88  percent. 

While  the  estimated  number  of  TACANs  and  their  deployment  were 
known  to  be  constantly  increasing,  ARINC  Research  used  the  AFLC 
provided  information  as  a starting  point  for  its  investigation.  In 
light  of  the  dynamic  state  of  the  program,  a basic  position  taken  with 
respect  to  those  increasing  numbers  was  that  ARINC  Research,  whenever 
feasible  within  time  amd  resources  constraints,  would  identify  and 
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collect  data  on  any  additional  (to  the  AFLC  accounting)  TACANs  that 
might  be  encountered  during  field  visits. 


Therefore,  with  the  physical  scope  of  the  TACAN  population  having 
been  identified,  the  emphasis  of  the  study  was  shifted  to  identifying 
the  statistical  information  needed  to  properly  assess  TACAN  equipment 
cind  warranty  performance.  This  topic  is  the  subject  of  Section  2.2 


2.2  IDENTIFICATION  OF  STATISTICAL  INFORMATION 
2.2.1  TACAN  Field  Data  Collection 


A primary  difference  between  field  and  contractual  estimates  of 
AOT,  TOH,  and  MTBF  is  that  field  calculations  are  based  on  information 
obtained  from  all  TACANs  in  the  Air  Force  inventory,  while  the 
contractual  information  is  drawn  only  from  pieces  of  equipment  that 
have  been  returned  to  the  contractor  because  of  failure  or  as  a 
result  of  error,  e.g. , nonverified  returns  and  exclusions. 

To  better  organize  and  process  the  information  from  the  "true" 
field  environment,  the  data  collection  form  shown  in  Figure  2-1  was 
developed. 


2. 2. 1.1  Data  Element  Discussion 

The  data  categories  shown  in  Figure  2-1  are  the  basic  elements 
needed  to  record  TACAN  field  experience.  Data  elements  such  as 
install  days  are  described  in  Colximns  C,  F,  and  G.  The  Total  Elapsed 
Time  is  determined  by  subtracting  Collins  ETI  Read  at  Ship  from  Column 
E,  ETI  Reading.  As  a point  of  historical  reference,  as 
well  as  for  use  in  determining  Installed  Days,  Column  H Date  Read  is 
also  included. 

Table  2-2  describes  the  data  elements  of  Figure  2-1. 

/ . 1.2  Contractual  Data  Collection 

Collins  information  only  on  failed  units  or  units 

returned  for  othm  l<•.lions  (nonv»*r  i f ied  returns  and  exclusions).  The 
emphasis  in  the  Collins  da)-i  is  on  iin-  nnmlx’r  of  failures,  total  _ 
elapsed  times,  total  install  days,  an«l  .ivni.t'jn  number  of  installs,  N. 

The  data  collection  form  for  this  information,  |.t<  n*ni«id  m 
Figure  2-2,  was  used  to  show,  for  each  base  visited,  each  failure 
(by  LRU  serial  number)  and  its  classification.  Also  presented  i • be 
ETI  reading  upon  receipt  by  Collins  (ETI  IN) , and  the  ETI  reading 
at  the  time  of  the  original  or  previous  Collins  shipment  (ETI  Prior). 


Figure  2-1.  AN/ARN-H8(V)  TACAN  ETI/INSTAU,  COLLECTION  FOFN  CPO  P09603-77-A-3104 


Table  2-2.  ELEMENTS  OF  TACAN  DATA  COLLECTION  FORM 


A.  Aircraft  Type  - Trainer  (T-38) , fighter/attack  (F-111,  A-7,  A-10) 
and  bomber/cargo  categories  (C-130s,  B-52s,  KC-135s,  VC-137s) . 

B.  Aircraft  Tail  Niimber  - The  military  identification  number  of  the 
aircraft  in  which  TACAN  is  installed. 

C.  R/T  Record  Card  Information  - A permanent  card,  affixed  to  the 
TACAN  R/T,  which  contains  information  regarding  install  and 
removal  dates.  Multiple  entries,  if  encountered,  would  document 
removals/installs  for  reasons  other  than  failures.  From  this 
record,  the  number  of  install  days  is  obtained. 

D.  R/T  Serial  Number  - Provides  a means  of  tracking  a specific 
piece  of  equipment  through  its  lifetime. 

E.  ETI  Reading  - Provides  an  accounting  of  actual  operating  time. 

F.  Flying  Hours  at  Install  - Establishes  a point  of  reference  in 
establishing  flying  hour  statistics. 

G.  Flying  Hours  _at  Reading  - Establishes  a point  of  reference  in 
establishing  flying  hour  statistics. 

H.  Date  Read  - Used  to  establish  cut-off  points  of  computations. 

I.  Collins  ETI  Reading  at  Ship  - Establishes  initialization  time 
for  subsequent  Air  Force  usage. 

J Comments  - Provided  for  any  required  special  notes  or  comments . 


it  Description  I Serial  Number 


Figure  2-2.  RETURNED  UNITS  FORM  CPO  F09603-77-A-3104 


The  difference  between  these  two  numbers,  A ETI,  yields  the  total 
operating  time  of  the  R/T.  The  next  Column,  A Install  Days,  yields 
the  total  period  of  calendar  days  during  which  the  TACAN  was  installed 
in  an  aircraft  as  a working  asset. 

Identification  of  the  statistical  information  required  for  the 
analysis  of  field  and  contractual  data  provided  a base  core  of 
variables  that  could  be  analyzed  and  evaluated  for  purposes  of 
computing  MTBF,  TOH,  and  AOT.  The  methods  by  which  these  variables 
were  to  be  analyzed  is  the  subject  of  Section  2.3. 

2.3  DEVEIOPMENT  OF  DATA  ANALYSIS  METHODS 

Following  identification  of  the  types  of  aircraft  in  which  the 
TACAN  were  installed,  together  the  information  needed  to  describe 
the  field  and  contractual  performance  of  the  equipment,  a method  of 
analyzing  the  obtained  data  was  developed. 

The  data  analysis  was  completed  for  the  following  categories 
(as  noted  in  the  Data  Accumulation  and  Evaluation  Plan,  Appendix  A) ; 

. Air  Force  Base  - 11  bases 

. Aircraft  Type  - T-38,  T-39,  A-10,  A-7,  F-111,  VC-137, 

C-130,  KC-135,  B-52 

. Generic  Type 

Trainer:  T-38,  T-39 
..  Fighter-Attack:  A-10,  A-7,  F-111 
..  Cargo/Bomber:  VC-137,  C-130,  KC-135,  B-52 

. Total  Air  Force  Fleet  (for  the  11  bases  visited) 

For  each  of  these  categories,  the  following  statistics  would  be 
calculated  by  both  the  field  and  contractual  methods : 

. Total  Operating  Hours,  TOH 

. Average  Operating  Time,  AOT 

. Install  Days 

. Average  Number  of  Installed  TACANs  during  the 
Measurement  Period,  N 

. MTBF  (by  LRU  and  TACAN  set) 
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2.4  DEVELOPMENT  OF  A SAMPLING  PLAN  FOR  DATA  COLLECTION 


The  Data  Collection  and  Evaluation  Plan  (Appendix  A)  was  developed 
as  the  outline  for  the  contractual  efforts  in  gathering  and  evaluating 
field  and  contractual  data.  As  such,  it  guided  the  actual  data  collec- 
tion activities. 

The  following  factors  influenced  the  development  of  the  plan: 

. Since  time  and  budget  constraints  did  not  permit  measurement 
of  all  TACAN  fleet  data,  the  ARINC  Research  approach  was 
to  visit  a limited  number  of  bases  and  attempt  to  collect 
100  percent  of  the  TACAN  data  available  at  these  bases. 

. Simple  or  stratified  sampling  of  TACANs  was  not  feasible 
since  such  methods  would  require  travel  to  nearly  all  bases 
and  in  some  cases  might  result  in  limited  data  collection 
(perhaps  only  a small  percentage  of  TACANs  would  be  available 
at  the  base) . 

. Data  would  be  collected  from  each  type  of  aircraft  that 
contains  TACANs. 

. When  an  aircraft  type  is  deployed  at  several  bases,  visits 
would  be  made  to  more  than  one  base. 

. At  each  base  visited,  a maximum  effort  to  read  100  percent 

of  the  TACAN  data  would  be  made.  If  aircraft  were  not  available 
for  reading,  blank  data  forms  would  be  left  for  completion 
and  submittal  to  ARINC  Research. 

. The  Air  Force,  under  the  direction  of  AFLC/I/3M,  would  collect 
TACAN  data  frcxn  sites  not  visited  by  ARINC  Research  and  would 
supply  these  data  to  ARINC  Research.  The  data  would  be  used, 
to  the  extent  possible,  to  extend  the  acquired  data  base. 

Table  2-3  illustrates  the  proposed  plan  for  the  TACAN  data 
collection.  Of  the  29  Air  Force  bases,  11  were  chosen  to  be  visited 
by  ARINC  Research,  for  the  combination  of  reasons  previously  detailed. 

At  these  bases,  572  out  of  a population  of  1,104  installs  were  projected 
to  be  read.  (Two  T-39s  at  Randolph  had  been  identified  following 
receipt  of  the  2 September  list  shown  in  Table  2-1) . These  readings 
would  include  a sampling  of  each  of  the  9 types  of  aircraft  currently 
containing  AN/ARN-118 (V)  TACANs. 
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Details  of  aircraft  and  TACAN  distribution  are  as  follows : 


FT  » 


. T-38  (621  installs) . These  aircraft  were  deployed  at  7 sites. 

However,  3 sites  in  Texas  have  296  (48  percent)  of  all  T-38 
Installations.  This  was  considered  a compact  arrangement 
that  would  minimize  inter-base  travel  requirements. 

. T-39  (2  installs) . These  aircraft  (2  planes)  were  deployed 

at  Randolph  AFB.  No  extra  travel  effort  for  obtaining 
these  data  was  envisioned. 

. F-111  (196  installs) . Significant  numbers  were  deployed  at 

Mountain  Home,  Idaho  (77),  and  Upper  Heyford,  England  (74). 
Inclusion  of  both  sites  would  have  imposed  unacceptable 
travel  requirements.  Therefore,  Mountain  Home  was  selected, 
and  these  sets  represented  39  percent  of  all  F-111  installs 
at  the  time  of  observation. 

. B-52  (104  installs) . The  B-52  TACANs  were  deployed  in  rather 

small  numbers  (from  2 to  20)  at  12  sites.  The  plan  provided 
for  visits  to  the  3 most  populous  bases  (one  in  Texas  and 
two  in  California) , which  contained  51  percent  of  the  TACAN 
population  at  the  time  of  observation. 

. Other  Aircraft.  For  other  types  of  aircraft,  a visit  was 
planned  either  to  the  sole  base  of  deployment  (VC-137  and 
KC-135)  or  to  the  base  of  greatest  deployment  (A-10,  A-7, 
and  C-130) . 

A total  of  572  aircraft,  or  52  percent  of  fleet  installs,  were 
scheduled  to  be  visited  under  this  plan.  Lines  (1)  through  (3)  of 
Table  2-3  show  other  features  of  the  plan.  Line  (1)  shows  the  total 
number  of  each  type  aircraft  to  be  sampled  during  the  field  visits. 

Line  (2)  shows  the  total  install  population  for  each  aircraft  type 
as  of  approximately  2 September  1977.  Line  (3)  shows  the  percentage 
of  total  installs  for  each  aircraft  type  proposed  to  be  sampled  during 
the  field  visits. 

2.5  FIELD  DATA  COLLECTION  SCHEDULE 

Figure  2-3  illustrates  the  planned  travel,  the  timing,  and  the 
individuals  associated  with  the  data  collection  for  the  TACANs.  The 
actual  field  data  collection  efforts  commenced  on  3 October  and  were 
completed  on  21  October,  exactly  as  planned  for  the  schedule  of 
Figure  2-3.  All  bases  scheduled  were  visited  as  noted.  The  actual  dates 
and  duration  of  each  visit,  however,  were  adjusted  to  accommodate  wor)c 
loads  and  Air  Force  Base  operations. 
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2.6  TACAN  DATA  COLLECTION  (Actual) 


As  discussed  previously  in  the  Data  Accumulation  and  Evaluation 
Plan,  approximately  50  percent  of  the  AN/ARN-118 (V)  TACANs  were  to  be 
surveyed  at  11  Air  Force  Bases  and  in  9 classes  of  aircraft.  The 
actual  field  distribution  as  determined  by  the  ARINC  Research  visits 
is  shown  in  Table  2-4,  which  illustrates  the  number  of  installed  TACANs 
by  aircraft  type  and  base.  As  an  example,  for  the  T-38s,  three  bases  — 
Reese,  Laughlin,  and  Randolph  — had  respective  total  installs  of  91, 

111,  and  105.  At  these  installations,  the  number  of  TACANs  with  usable 
readings  were,  respectively,  79,  111,  and  72. 

All  data  from  these  AF  Bases  were  used  in  the  computations  except 
F-111  data.  Mountain  Home  AFB.  Base  level  computations  for  Mountain 
Home  AFB,  are  shown  in  Table  3-1,  Chapter  Three,  but  for  information 
purposes  only.  ALL  F-111  aircraft  observed  at  Mountain  Home  AFB  were 
transfers  from  Nellis  AFB.  It  could  not  be  determined  whether  actual 
installs  were  made  by  Mountain  Home  or  or  sc«ne  or  all  of  the  F-llls 
had  AN/ARN-118 (V)  TACANs  on  arrival. 

While  Table  2-4  is  similar  to  Table  2-3,  there  are  several 
differences  in  categories?  therefore,  the  table  is  explained  in  the 
following  paragraphs. 

Lines  (1)  through  (5)  provide  additional  statistical  information. 

Line  (1)  shows  that  764  TACANs  were  recorded  as  installed  in  the  USAF 
bases  visited,  in  contrast  with  the  572  installed  TACANs  that  were 
planned  to  be  read  on  the  basis  of  the  data  of  2 September.  The  table 
shows  that  307  TACANs  were  installed  in  T-38s,  2 in  T-39s,  24  in  A-lOs, 
etc.  Comparing  line  1 of  Table  2-4  with  line  1 of  Table  2-3  shows 
that  T-38s,  A-7s,  F-llls,  C-130s,  and  B-52s  have,  in  some  cases 
(especially  in  A-7s  and  C-130s) , a significantly  larger  number  of 
installs  than  expected. 

Line  (2)  of  Table  2-4  shows  that  558  installed  TACANs  provided 
usable  readings  out  of  a possible  762  installs.  There  are  three  basic 
reasons  for  unavailability  of  aircraft:  (1)  flying  schedules  that  prevented 
access  to  aircraft;  (2)  maintencince  actions,  such  as  fuel  system 
repairs;  and  (3)  especially  in  the  B-52  fleet,  the  alert  status,  which 
imposed  strict  security  procedures  on  those  aircraft.  As  an  example 
of  the  contents  of  line  (2) , and  its  relationship  to  line  (3) , 262 
TACANs  had  usable  readings  out  of  a possible  307  installed  in  T-38s,  for 
85.3  percent  of  the  total  possible  readings.  For  the  T-39s,  1 of  2 
(50  percent)  and  for  the  A-lOs,  24  of  24  (100  percent)  were  read.  The 
other  aircraft  statistics  are  presented  in  the  same  manner. 

Line  4 yields  a total  (based  on  the  bases  visited)  of  1296  installs. 
When  compared  with  Table  2-3,  line  (2)  of  Table  2-4  shows  that  the  A-7s 
had  the  largest  increase  in  the  number  of  TACANs  installed. 


Line  (5)  of  Taible  2-4  gives  the  individual  percentages  for  the 
aircraft  based  on  a total  population  (estimated  from  the  information 
gained  only  at  the  Air  Force  Bases  visited)  of  1296  installed  TACANs. 
As  shown,  the  262  TACANs  read  out  of  a possible  (estimated)  total  of 
TACANs  installed  in  T-38s  (632)  yields  a percentage  of  41.4  percent. 
For  other  aircraft,  such  as  the  A-7,  77  of  the  estimated  85  pleines 
(90.5  percent)  containing  TACANs  were  read.  Foe  the  total  fleet. 

558  of  1296  (estimated)  TACANs  could  be  read,  yielding  43  percent. 
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CHAPTER  THREE 


COMPARISON  OF  FIELD 
AND  CONTRACTUAL  COMPUTATIONS 


3.1  BACKGROUND 

The  primary  objective  of  this  study  was  to  determine  whether  the 
contractual  method  of  estimating  average  operate  time  (AOT) , total 
operate  hours  (TOH) , and  mean  time  between  failures  (MTBF)  for  the 
AN/ARN-118 (V)  TACAN  adequately  reflects  actual  field  experience  for  these 
parameters.  As  noted  in  the  previous  chapters,  data  were  collected 
directly  by  visiting  11  Air  Force  bases  (Appendix  B)  and  the  AN/ARN- 
118  (V)  manufacturer  (Appendix  C)  to  determine  actual  field  performance. 

This  chapter  presents  results  developed  from  these  field  data 
and  the  equivalent  contractual  computations. 

3.2  BASIC  DATA  COLLECTION  AND  PROCESSING 

The  data  represented  in  Appendixes  B and  C represent  all  field 
experience  from  "initial  install"  to  "read"  for  each  base. 

3.2.1  Basic  Field  Data 

The  basic  data  were  collected  on  the  work  sheet  illustrated  in 
Figure  2-2 . The  information  was  transcribed  to  the  format  shown  in 
^^pendix  B,  and  preliminary  calculations  were  made  to  develop  the 
differences  in  ETI  hours,  install  days,  and  flying  hours.  These  data 
were  supplemented  by  the  Collins  information  presented  in  Appendix  C. 

The  sources  for  the  entries  are  as  follows: 

Column  Entry 

Column  1 Each  base  was  identified,  e.g.,  Andrews  AFB 

Aircraft  Type  Each  aircraft  was  identified  by  direct  observation. 

Column  2 Each  aircraft  tail  number  was  identified  by  direct 

Aircraft  Tail  observation,  with  the  exception  of  aircraft  that 
Number  were  away  from  the  base  on  temporary  duty.  For 

these  aircraft,  the  data  were  received  by  phone 
message  from  the  "away"  base. 


Column 


Column  3 
R/T  Serial 
Number 

Column  4 
ETI  Hours 
at  Read 

Column  5 
ETI  Hours 
at  Ship 


Column  6 
A ETI  Hours 

Column  7 

R/T  Record  Card 

Install/Remove 

Dates 


Column  8 
Date  Read 

Column  9 
A Install  Days 


Column  10 
Flying  Hours 
at  Read 


Column  11 
Flying  Hours 
at  Install 


Entry 

Each  R/T  serial  number  was  obtained  by  direct 
reading  of  the  unit,  with  the  exception  noted 
previously . 

Each  ETI  was  read  directly  from  the  R/T  unit 
observed,  with  the  exceptions  noted  previously 


With  few  exceptions,  the  ETI  at  shipment  (from 
manufacturer)  had  to  be  obtained  from  the 
manufacturer's  data  documents  as  follows: 

Log  1 - Initial  Delivery  Record 
Log  2 - Subsequent  Delivery  Record 
Log  3 - Corrective  Action  Summary 

The  A ETIs  were  computed  by  taking  the  difference 
between  entries  in  Columns  4 and  5. 

The  install  and  remove  dates  were  read  directly 
from  the  cards  attached  to  each  R/T  unit.  In 
many  instances,  entries  either  had  not  been  made 
or  had  been  made  incorrectly.  In  these  cases,  the 
Time  Compliance  Technical  Order  (TCTO)  information 
was  used  to  fill  in  or  correct  the  install  data. 

The  TCTO  records  were  usually  the  output  from 
base  computer  programs. 

The  date  of  the  observation  was  entered  by  the 
observer  at  the  time  of  reading. 

The  number  of  install  days  was  computed  by  taking 
the  difference  between  entries  in  Columns  7 and  8. 
In  a few  instances  where  removals  were  entered, 
the  interval  was  taken  from  the  install  and  remove 
dates. 

Flying  hours  at  read  were  taken  from  the  aircraft's 
Flying  Hour  Log  and  Maintenance  Record.  At 
Castle  AFB,  the  flying  hours  were  taken  from  a 
squadron -maintained  record. 

Same  source  as  for  Column  10. 
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Column 


Entry 


Column  12  The  A flying  hours  were  computed  by  taking  the 

A Flying  Hours  difference  between  entries  in  Columns  10  and 

11. 


1 


3.2.2  Manufacturer's  Data 

Other  data  required  in  the  ccwaputations  were  collected  from  the 
TACAN  manufacturer.  These  data,  shown  in  Appendix  C,  address  the  units 
returned  to  the  manufacturer,  for  test  verification  or  repair,  from 
the  Air  Force  bases  visited  by  the  project  team.  Since  these  units 
were  returned,  their  times  could  not  be  recorded  at  the  bases  visited. 

In  addition,  the  manufacturer's  records  had  to  be  studied  to  determine 
the  number  of  valid  failures  (e.g. , some  units  were  classified  as 
excluded  or  nonverified  failures) . Units  classified  as  excluded  or 
nonverified  could  not  be  used  in  determining  failure  totals.  ETI  and 
install  days  information,  where  entered  on  returned  R/T  units,  were 
combined  with  other  field  data  in  the  computations.  The  data  shown  in 
Appendix  C include  the  following; 

Entry 

The  origin  (AF  Base)  of  each  return  is 
identified. 

These  data  were  taken  from  the  manufacturer's 
Log  3 (Corrective  Action  Summary) : 

R/T  - Receiver/Transmitter 
MX  - Analog/Digital  Converter 
MT  - Mount 
Control  - Control  Box 

The  serial  number  was  taken  from  the 
manufacturer's  Log  3 (Corrective  Action 
Summary) . 

The  failure  classifications  were  taken  from 
Log  3 (Corrective  Action  Summary) : 

V - Verified  failure 
NV  - Nonverified  failure 
EXC  - Exclusion 


Heading/Column 

Heading 


Column  1 

Unit  Description 


Column  2 
Serial  Number 


Column  3 
Failure 

Classification 


I 
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Heading/Column 


Entry 


Column  4 
ETI  In 


Column  5 
ETI  Prior 


Column  6 
A ETI 


The  ETI  In  is  the  ETI  reading  of  a returned  R/T 
unit  when  it  is  received  by  the  manufacturer. 
These  entries  were  taken  from  Log  3 (Corrective 
Action  Summary).  In  some  instances,  Repair  Data 
Sheets  (RDS)  developed  by  the  mcuiufacturer  were 
used  to  check  Log  3 entries. 

The  prior  ETI  indication  represents  the  hours 
recorded  on  an  R/T  ETI  when  the  unit  previously 
left  the  manufacturer's  documents; 

Log  1 - Initial  Delivery  Record 
Log  2 - Subsequent  Delivery  Record 
Log  3 - Corrective  Action  Summary 

The  ETI  interval  was  computed  by  taking  the 
difference  between  the  entries  of  Columns 
4 and  5. 


Column  7 The  number  of  days  from  actual  install  to  read/ 

A Install  Days  remove  days  for  a returned  R/T  were  obtained 
from  Log  3 (Corrective  Action  Summary) . 


Column  8 Column  8 carries  any  special  notation  that  helps 

Comments  clarify  the  previous  entries;  e.g.,  in  some 

cases  no  entries  are  made  since  no  failures  were 
returned  to  the  manufacturer. 


3.3  ILLUSTRATIVE  BASE-LEVEL  COMPUTATIONS 
3.3.1  Field  Computations 

Randolph  Air  Force  Base  is  chosen  to  illustrate  the  field  computation 
procedures.  In  the  field  computation,  data  read  from  the  base  visits 
are  used  and  the  AOT,  TOH,  and  MTBF  calculated.  The  basic  data  collected 
and  used  in  this  illustration  are  presented  in  Appendixes  B and  C. 

3. 3. 3.1  Field  Average  Operating  Time  (AOT)  Computation 
Total  Operate  Hours 

The  sum  of  the  A ETI  hours  taken  from  Randolph  AFB  (Appendix 
B)  was  as  follows: 

I A ETI  = 27,618 

obtained  by  summing  all  A ETIs  (Column  6,  Appendix  B) . While 
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installed  TACANs  totaled  91,  not  all  installs  could  In-  -.uk  w aircraft 

were  not  available.  As  a consequence,  only  80  of  the  total  9i 
could  be  used  in  the  computation.  Since  it  was  necessary  to  estimate 
the  total  AFB  operation,  the  actual  readings  were  extrapolated  as 
follows: 


Extended  Operate  Hours  (Randolph  AFB)  = 27,618  hours  (actual)  x 


91  Total  Installs 
80  Usable  Reads 


31,415.5  hours 


Note;  The  operate  hours  noted  alaove  cover  the  period  from  the  initial 
inst£_ll  (31  December  1975)  to  the  date  of  read  (October  7-11, 
1977. 


This  does  not  represent  the  total  operate  hours  over  the  time 
interval  (December  1975  through  October  1977) . The  operate  hours  for 
units  returned  to  the  manufacturer  for  verification  or  repair  also 
represent  activity  for  the  Randolph  AFB  aircraft  fleet.  These  times 
were  added  to  the  direct  reads  to  complete  the  total  operate  time. 
Thus  for  R/Ts  operating  at  Randolph  but  returned  to  Collins, 

Z A ETIs  - 7374  hours 

These  data  were  taken  from  the  R/T  return  records 
(Sum  of  A ETIs,  Column  6,  Appendix  C - Randolph  AFB) . 

In  this  case,  all  ETI  readings  could  be  used.  If  it  had  been 
necessary,  the  operating  (ETI)  hours  would  have  been  extended, 
using  the  ratio  of  total  R/T  returns  to  the  number  of  actual  reads. 

7374  ETI  X 31  Total  R/T  returns  = 7374  hours 
31  Reads 

This  figure  was  then  added  to  the  Extended  Operate  Hours  at  the 
base,  i.e.. 


Total  Operate  Hours  = 31,415.5  hours  + 7374.0  hours 

= 38,789.5  hours 

Sum  of  Install  Days 

The  sum  of  the  install  days  for  TACANs  at  Randolph  AFB 
(Appendix  B)  was  as  follows: 

E A Install  Days  = 19,187  days 
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This  total  was  arrived  at  by  sianming  all  A Install  Days  (Column  9, 
Randolph  AFB,  Appendix  B) . The  install  days  were  extended  in  a manner 
identical  to  the  ETIs. 


Extended  Install  Days  (Randolph  AFB)  = 19,187  install  days  x 


91  Total  Installs 
75  Reads 


= 23,280.2  install  days 


w>»h  the-  KTT  information,  it  is  necessary  to  agument  the 
install  day  inf ',i  ■»-•«  i include  R/Ts  returned  from  Randolph  to 

Collins.  Install  dayt,  fr<j«i  the  r*-»urned  R/Ts  were  computed  by  summing 
the  A Install  Days  (Column  V,  A{.,|rf-t,dix  f,  Randolph  AFB). 

Z!  A Install  Days  = 3459  instai  l 'Mv*- 

The  install  days  data  were  extended  in  the  same  manix-i 
for  the  ETIs: 

3459  Install  Days  x = 4467.9  total  install  days 

^ 24  Reads 

Thus  the  total  installed  days  are  23280.2  + 4467.9  or  27748.1. 

Field  Average  Operate  Time  (APT) 

The  field  AOT  was  computed  as  follows: 


Total  Operate  Hours 
Total  Installed  Days 


38789.5  hours 
27748.4  days 


AOT  = 1.3979  operate  hours  per  install  day 

3. 3. 1.2  Total  Field  Operate  Hours  TOH) 

The  field  TOH  for  Randolph  AFB  over  the  observation  interval 
(December  1975  through  October  1977)  is  the  sum  of  the  ETI  hours,  or 
38789.5  hours  as  noted  previously. 

3. 3. 1.3  Field  Mean  Time  Between  Failures  (MTBF) 

The  field  MTBFs  for  each  subunit  of  the  TACAN  set  were  computed 
on  the  basis  of  the  number  of  returns  as  follows; 

31  R/Ts 

13  Converters 
1 Mount 

14  Controls 
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Out  of  the  31  R/Ts,  3 were  classified  as  nonverified  and  one  was  an 
exclusion.  As  a consequence,  27  valid  R/T  failures  returned  were 
used  to  compute  MTBF; 


I 


38789.5  Total  Operate  Hours  , , , 

Field  MTBF  R/T  = , . ■ ■ = 1436.6  hours 

27  Valid  Failures 

^ 38789.5  Total  Operate  Hours  r i. 

Field  MTBF  Converter  = ^ . „ , . , - ■ , = 2983.5  hours 

13  Valid  Failures 


Field  MTBF  Mount  = 


38789.5  hours 
1 Valid  Failure 


= 38789.5  hours 


_ , 38789.5  Operate  Hours  x 2 Controls/set 

Field  MTBF  Control  = , = 

14  Valid  Failures 

5541.4  hours 


Field  MTBF  Set  = 1 

111,1  = 808.1  hours 

1436.6  ^ 5541.4  2983.8  38789.5 

hours  hours  hours  hours 

t.«  ..  level)  computational  approach  for  the  other  bases 

V ■.*  1 i«l  manner.  The  basic  data  can  be  reviewed  in 
■ ■ ‘ Base  l,evel  results  can  be  seen  in 


3.3.2  Contractual  Computations 

The  equivalent  computations  for  the  AOT,  Ton,  j:  i 
contractual  approach  are  based  on  the  ETI  hours  and  instai  . i.. . 
returned  R/T  units  only  (Appendix  C)  (only  the  R/T  unit  has  ETI  ati'i 
install/remove  data  recorded  on  a card  attached  to  the  front  of  the 
unit).  In  addition,  extension  of  these  data  to  reflect  total  iristall 
operation  must  be  computed  in  a different  manner. 

The  following  subsections  provide  an  example  of  the  contractual 
computation,  again  using  Randolph  AFB  data. 

3 . 3 . 2 . 1 Contractual  Average  Operate  Time 

The  contractual  AOT  is  computed  as  follows; 


wa.. 

Appendixes  b 
Table  3-1. 


(continued) 


Sum  of  ETIs  (operate  time) 


Z ETIs  = 5582  hours  taken  from  returned  R/Ts  only 

(sum  of  A ETIs,  Column  6,  Appendix  C,  Randolph  AFB) 


NOTE:  Only  ETI  hours  that  have  a corresponding 
install-day  entry  can  be  used. 


Sum  of  Install  Days 


E Install  Days  = 3459.0  days  taken  from  the  returned  R/Ts 

only  (sum  of  A install  days. 

Column  9,  Appendix  C,  Randolph  AFB) 


NOTE:  Only  install  days  that  have  a corresponding 
ETI  entry  can  be  used. 


Then 


AOT  = 


Sum  of  ETI 


Sum  of  Install  Days 


5582  Operate  Hours  , ^ n j 

= T ■■■■  .' — ^ — = 1.6138  operate  hours  per  install  day 

3459  Install  Days  c 


3. 3. 2. 2 Total  Contractual  Operate  Hours  (TOH) 
The  contractual  TOH  computation  is  as  follows: 
TOH  = D X AOT  X N 


where 


AOT  = 1.6138  operate  hours  per  install  day  as  computed  above 


D = Number  of  days  in  the  observation  period  taken  from 

the  date  of  the  initial  install  to  the  day  of  the  read. 


For  Randolph  AFB: 

Initial  Install  - 31  December  1975 
Last  day  of  read  - 12  October  1977 
Interval  = 652  days 


N = Average  number  of  TACANs  installed  over  the 
observation  period 


1: 


Ji 


l! 

I; 


j i 


3-10 


and 


M 

N = J:  n./M 

i=l  ^ 

= Cumulative  TACANs  installed  by  month 

M = Total  months  of  observation 

NOTE:  The  manufacturer  received  monthly  from  the 
USAF  the  number  of  installs  for  a given 
month.  The  number  of  installs  in  a given 
month  is  the  number  installed  as  of  the  last 
day  of  that  month. 

For  the  Randolph  AFB  exaunple*: 

1975  1976 

Dec  Jan  Feb  Mar  Apr  May  Jun  Jul  Aug  Sep  Oct  Nov 

1 install  + 12  + 12  + 15  + 15  + 15  + 15  + 15  + 15  + 15  + 15  + 24 

1977 

Dec  Jan  Feb  Mar  Apr  May  Jun  Jul  Aug  Sep  Oct  12th 

+ 66  + 83  + 85  + 85  + 85  +85+85+86+86+90+90 

22 . 39  months 

where  22.39  months  of  observation  = 

22  months  + 12  days/31  days  in  Oct  = 22.39  mos. 


N = 48.91  average  installs  per  month 
TOH  = D X AOT  X N 

= 652  days  X 1.6138  hour/install  day  X 48.91  average  installs 

= 51463.0  Total  Operate  Hours 

3. 3. 2. 3 Contractual  Mean  Time  Between  Failures  (MTBF) 

The  contractual  MTBFs  are  computed  in  much  the  same  way  as  those 
for  the  field  except  that  in  this  approach  the  TOH  as  computed  above 
is  used: 


*The  cumulative  value  of  TACANs  installed  at  Randolph  AFB  by  month  was 
taken  from  References  1-5,  Appendix  B,  and  information  provided  by  the 
Base  Time  Compliance  Technical  Order  (TCTO) . 
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Ai 


Contractual 

MTBF 

R/T 


51463.0  hours 
27  valid  failures 


1906.0  hours 


Contractual 

MTBF 

Converter 


51463.0  hours 
13  valid  failures 


3958.7  hours 


Contractual 

MTBF 

Mount 


51463.0  hours 
1 valid  failure 


51463.0  hours 


Contractual 

MTBF 

Control 


51463.0  hours  X 2 Controls  per  set 
14  valid  failures 


7351.9  hours 


Contractual 

MTBF 

Set 


1906  3958.7 


51463.0  7351.9 


= 1072.1  hours 


The  contractual  computations  for  other  Air  Force  bases  are 
performed  in  a similar  manner.  Basic  data  used  can  be  found  in 
Appendixes  B and  C.  The  results  are  summarized  in  Table  3-1. 

3.4  ILLUSTRATIVE  COMPUTATIONS  BY  PLATFORM  TYPE 


3.4.1  Field  Computations 

In  addition  to  computations  made  at  the  base  level,  the  data 
were  integrated  to  reflect  the  following: 

Computations  (AOT,  TOH,  MTBFs)  by: 

. Trainers  (T-38,  T-39) 

. Heavy  Platforms  (B-52,  KC-135,  VC-137,  C-130) 

. Attack  (A-7,  A-10)* 

*N0TE:  F-111  data  for  Mountain  Home  AFB  were  not  included 
in  the  integration  (see  Section  2.6) 

All  aircraft  at  the  11  bases  visited 


I 

I 

j 

] 

I 

1 

) 

1 

1 


) 

l 


) 

} 
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A computation  using  the  heavy  platform  type  aircraft  will  be 
used  as  an  illustration.  The  basic  data  are  from  the  same  sources 
as  noted  in  the  base-level  illustration,  i.e.,  Appendixes  B and  C. 

In  addition,  the  results  of  the  base-level  computation  (Table  3-1) 
are  used  to  complete  the  integration  computation.  The  illustrative 
computation  is  presented  in  the  following  subsections. 

3. 4. 1.1  Field  Average  Operating  Time  (APT)  Computation  (B-52 , 
KC-135,  VC-137,  C-130  Aircraft) 


The  total  (ETI)  operating  hours  and  install  days  for  each  AFB 
responsible  for  the  heavy  aircraft  are  obtained  from  Table  3-1  and 
Appendix  B for  March  AFB  (B-52),  Carswell  AFB  (B-52),  Little  Rdc)c  AFB 
(C-130),  Andrews  AFB  (VC-137),  and  Castle  AFB  (B-52,  KC-135). 


Field  March  Carswell  Little  Rock  Andrews  Castle 

ACT  1816.7  hrs.  + 3006.6  hrs  + 54361.8  hrs.  + 1069.0  + 20935.4 

Heavy  Platform  1323.0  + 1881.9  + 28327.7  + 939.0  + 8426.0 

Inst.  Days  Inst.  Days  Inst.  Days  Inst.  Days  Inst.  Days 

Field 

AOT  = 1.9852  Operate  Hours  per  install  day 

Heavy  Platform 

3.4. 1.2  Field  Total  Operating  Hours  (TOH)  (B-52,  KC-135, 

VC-137,  C-130  Aircraft) 

The  TOH  is  the  sum  of  the  (ETI)  operating  hours  for  the  based 
noted  above: 


Field 

TOH 

Heavy  Platform 


March  Carswell  Little  Rock  Andrews  Castle 

1816.7  hrs  + 3006.6  hrs  + 54361.8  hrs  + 1069.0  hrs  + 20935.4  hrs. 


Field 

TOH 

Heavy  Platform 


81189.5  Operating  Hours 


3.4. 1.3  Field  Mean  Time  Between  Failure  (MTBF)  (B-52,  KC-135, 
VC-137,  C-130  Aircraft 


The  MTBFs  for  the  heavy  platform  aircraft  are  computed  by  using 
the  TOHs  for  the  bases  noted.  The  basic  data  sources  are  Appendixes 
B and  C,  from  which  these  computations  have  been  developed. 
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Field 
MTBF  R/T 
Heavy  Platform 


81189.5  operatinq  hours  _ . 

-I'j'j  p/tn'  c •? “ 2387.9  hours 

34  Valid  R/T  failures 


Field  MTBF 
Converter  = 
Heavy  Platform 


81189.5  operating  hours 
8 valid  converter  failures 


= 10148.7  hours 


Field  MTBF 
Mount  = 

Heavy  Platform 


No  Valid  Failures 


Field  MTBF 
Control  Box  = 
Heavy  Platform 


81189.5  operating  hours 
1 valid  failure 


= 81189.5  hours 


Field  MTBF 
Set 

Heavy  Platform 


= 1888.1  hrs 


2387.9  hrs 
(R/T) 


10148.7  hrs 
(Conv. ) 


N.F. 

(Mt.) 


81189.5  hrs 
(Control  Box) 


3.4.2  Contractual  Computations 


3.4. 2.1  Contractual  Average  Operating  Time  (APT)  Computation  (B-52, 
KC-135,  VC-137,  C-130  Aircraft) 


The  total  (ETI)  operating  hours  and  install  days  for  each  base 
responsible  for  the  heavy  aircraft  are  obtained  from  Table  3-1  (contractual 
entries).  It  is  again  noted  that  the  operating  hours  and  install  days 
in  this  computation  are  based  on'.y  on  R/Ts  returned  to  the  manufacturer. 


i 


The  following  entries  (contractual)  were  developed  from  data  in 
Appendix  C (Note:  Only  data  were  used  that  have  both  an  A ETI  and 
corresponding  A Install  Day  entry) : 


Contractual 

AOT 

Heavy  Platform 


March  Carswell  Little  Rock  *Andrews  Castle 

6 hrs  74  hrs  ^ 506  hrs  - 4295  hrs. 


6 20 
Inst.  + Inst, 
days  days 


235 
+ Inst, 
days 


1595 

Inst 

days 


♦NOTE:  there  were  no  returned  R/Ts  from  Andrews  AFB. 
Contractual 


AOT  = 2.630  operating  hours  per  install  day 

Heavy  Platform 


t 


'h 


► 


3. 4. 2. 2 Contractual  Total  Operating  Hours  (TOH)  (B-52,  KC-135, 

VC-137,  C-130  Aircraft) 

The  total  operating  hours  are  tak.en  from  Table  3-1  for  the  base/ 
aircraft  of  interest. 

March  Carswell  Little  Rock  Andrews  ^ Castle 

1357.2  hrs  * 8663.4  hrs  59841.2  hrs  (No  re-  28483.0 

turned  R/Ts) 


= 98344.8  operating  hours 


3. 4. 2. 3 Contractual  Mean  Time  Between  Failure  (MTBF)  (B-52, 
KC-135,  VC-137,  C-130  Aircraft) 

The  MTBFs  for  the  heavy  platform  aircraft  are  computed  from  the 
TOHs  developed  in  Subsection  3. 4. 2. 2.  The  failure  data  are  taken 
from  Appendix  C. 

Contractual 
MTBF  R/T 
Heavy  Platform 

Contractual 
MTBF  Converter  = 

Heavy  Platform 

Contractual 
MTBF  Mount 
Heavy  Platform 

Contractual 
MTBF 

Control  Box 
Heavy  Platform 

Contractual 
MTBF  Set 
Heavy  Platform 


Contractual 
MTBF  Set 
Heavy  Platform 


98344.8  operating  hours  ^ , 

— , . , ^ ; — ■ . = 2892.5  hours 

34  valid  R/T  failures 


98344,8  operating  hours ^ 12293.1  hours 

8 valid  converter  failures 


No  Valid  Failures 


98344.8 


1 valid  failure 


= 98344.8  hours 


2892.5  hrs  12293.1  hrs 
(R/T)  (Conv.) 


2287.1  hours 


+ N.F.  + 


98344.8  hrs 
(Mt.)  (Control) 


Contractual 

TOH 

Heavi'  Platform 

Contractual 

TOH 

Heavy  Platform 


3-15 


1 


A summary  of  ccanputational  results  for  the  three  aircraft 
categories  can  be  seen  in  Table  3-2.  Ccxnputations  for  the  "Trainer" 
and  "Attack"  categories  were  performed  in  the,,  same  manner  as  for  the 
"Heavy  Platform". 

3.5  GRAND  TOTAL  (ALL  AIRCRAFT)  COMPUTATIONS 

The  Grand  Total*  computations  were  performed  in  the  same  manner 
as  the  aircraft  categories,  except  that  all  data  were  used  in  the 
computation.  The  Grand  Total  Computation  results  can  be  seen  in 
Table  3-3.  The  data  sources  from  which  the  computations  were  developed 
are  identical  to  those  noted  previously. 

3.6  DISCUSSION  - FIELD  VS.  CONTRACTUAL  COMPUTATIONS 


Table  3-1,  3-2,  and  3-3  represent  the  comparative  results  for  the 
three  levels  of  computation,  i.e. , by  base,  aircraft  type,  and  total. 

Data  were  collected  from  eleven  Air  Force  Bases  and  the  manufacturer 
by  field  engineers.  The  "field"  computations  noted  in  the  tables  are 
the  results  of  computations  using  these  data.  The  "contractual" 
computations  were  developed  primarily  from  records  taken  from  the  TACAN 
manufactuerer' s warranty  logs.  The  average  number  of  installs  per  month 
(N)  was  obtained  through  data  collected  from  the  various  Air  Force  _ 
Bases  (install  data  from  R/T  record  cards  and  TCTO  information) . The  N, 
although  obtained  through  base  visits,  was  used  in  (and  only  in)  the 
"contractual"  computation. 

As  noted  previously,  the  primary  objective  of  this  study  was  to 
determine  whether  the  contractual  method  of  estimating  AOT,  TOH,  and  MTBF 
adequately  reflected  actual  field  performance.  The  following  sections 
present  a comparison  between  the  field  results  and  the  contractual 
approach. 


Base, 


Comparisons  have  been  developed  for  thre  levels  of  aggregations  — 
Aircraft  Type,  and  Total. 


3.6.1  Field  vs.  Contractual  Computations  - Base  Level 


Table  3-1  breaks  out  the  computational  results  for  the  eleven 
bases  visited.  The  field  computations  are  shown  with  the  equivalent 
contractual  results  for  each  of  the  bases.  It  is  noted  that  computa- 
tions for  Mountain  Home  AFB  are  in  Table  3-1.  These  results  should  be 
viewed  with  some  reservations  for  the  following  reasons: 


*As  is  noted  in  Tcible  3-2,  there  were  substantial  differences  in  AOT, 
i TOH,  and  MTBF  between  aircraft  categories.  This  suggests  that  each 

i category  may  be  from  statistically  different  populations  cuid  data  should 

! not  be  consolidated  into  a singel  data  set  since  they  are  nonhomogeneous . 

[ The  grand  total  computation  is  done  here  to  develop  a quantitative 

; measure  that  can  be  compared  with  the  existing  contractual  methods. 

I 
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, All  install  reads  at  Mountain  Home  AFB  were  on  planes 
transferred  from  Nellis  AFB.  There  is  a gap  of  approxi- 
mately one  year  in  data.  (The  initial  installs  were 
made  at  I ij-lis  AFB  starting  in  February  1976.  The 
Mountain  Home  TCTO  shows  compliance  starting  in  March 
1977) . 

. It  could  not  be  determined  whether  actual  installs  were 
made  by  Mountain  Hcane  on  planes  transferred  from  Nellis 
AFB  or  some  (or  all)  of  the  F-llls  had  AN/ARN-118 (V) s 
on  arrival. 

As  a consequence,  the  Mountain  Home  AFB  data  were  not  included  in 
aircraft  category  computations  (Table  3-2)  or  the  Grand  Total 
(Table  3-3) . 


3. 6. 1.1  AOT  and  TOH  Comparison 


The  AOTs  and  TOHs  at  the  Base  Level  of  Comparison  (Table  3-1) 
indicate  variations  in  both  numercial  value  and  orientation.  In 
some  instances  contractual  values  are  higher  and  in  others  they  are 
lower  than  the  corresponding  field  computations. 


The  variations  should  be  expected  on  the  basis  of  large 
differences  in  operating  hours  between  bases  and  the  variation  in  the 
number  of  R/T  units  returned  from  each  base  that  were  used  to  calculate 
contractual  hours. 


To  facilitate  ccsnpabisons  between  field  and  contractual  AOTs  and 
TOHs,  Table  3-4  and  Figure  3-1  were  developed.  Table  3-4  presents, 
for  each  AF  Base  visited,  the  ratios  between: 

AOT  (Contractual) 

AOT  Field 


and 

TOH  (Contractual) 

TOH  (Field) 

Other  data  shown  in  Table  3-4  were  taken  from  Table  3-1  and 
repeated  in  Table  3-4  for  the  convenience  of  the  reader . 

If  the  field  and  contractual  computations  yielded  identical 
results,  the  AOT  ratios  should  be  equal  to  1.0;  e.g.. 


t 

t 
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Figure  3-1.  RATIO  DISPERSION  FOR  AOT/TOH 


1.0 


APT  (Contractual)  = 55,000  hour /day 
AOT  Field  = 55,000  hour/day 


The  same  can  be  said  for  the  TOH  ratios. 

Figure  3-1  is  a graphic  representation  of  the  AOT  ratios  as  a 
function  of  total  field  operating  hours  by  Air  Force  Base  visited. 

Also  shown  are  the  TOH  ratios  for  the  same  bases.  All  bases  cannot 
be  shown  in  Figure  3-1  since  some  bases  had  no  failure  experiences 
or  there  were  no  valid  R/T  returns  upon  which  to  develop  contractual 
ratios.  Where  data  were  available,  the  base  and  AOT  and  TOH  ratios 
are  shown . 

As  can  be  seen  in  Figure  3-1,  as  the  operating-hour  experiences 
are  longer,  there  is  a tendency  for  the  AOT  and  TOH  ratios  to  draw 
closer  to  the  1.0  line  (i.e.,  the  differences  between  contractual 
and  field  AOT  values  are  less,  as  are  the  TOH  values) . 

Above  20,000  operating  hours,  all  AOT  ratios  are  within  20 
percc-.it  of  agreement  (i.e.,  ratios  are  between  0.8  and  1.2).  All  TOH 
ratios  for  the  sesne  bases  are  within  35  percent.  March  Air  Force  Base, 
with  slightly  under  20,000  operating  hours,  has  an  AOT  ratio  of 
73  percent. 

AOT  and  TOH  ratios  for  bases  such  as  Carswell  and  Laughlin 
and  Davis-Monthan,  with  fewer  operating  hours  indicate  greater  dispersion. 

The  results  shown  in  Figure  3-1  would  suggest  that  as  the  TACAN 
equipments  acquire  longer  operating  experience,  the  difference  between 
field  and  contractual  estimates  will  become  smaller;  i.e.,  AOT  and  TOH 
ratios  will  converge. 

3. 6.1. 2 MTBF  Comparisons 

The  TACAN  Set  MTBFs  as  developed  by  the  computational  approaches 
also  indicate  numerical  differences,  as  can  be  noted  in  Table  3-1.  Such 
differences  should  be  expected  since  the  operating  hour  estimates  are 
based  on  different  data  populations.  For  example,  the  TOHs  for  the 
field  computations  included  data  collected  from  as  many  installs  as 
could  be  read.  The  contractual  TOH,  on  the  other  hand,  is  based  only 
on  data  gathered  from  unit  returns.  In  three  of  the  eleven  bases 
visited,  field  and  contractual  MTBFs  could  not  be  compared  since  there 
were  no  returned  R/T  failures  from  which  the  contractor  could  malce  a 
computation.  Of  the  remaining  eight  bases  visited,  the  contractual 
computation  is  lower  at  three  bases  (Reese,  March,  Davis-Monthan)  cind 
higher  at  five  bases  (Laughlin,  Randolph,  Castle,  Carswell,  and  Little 
Roc)c) . The  base-level  computations  suggest  that  the  contractual 
method  is  more  often  higher  than  the  field  estimate. 
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„ • , A MTBF  Hours  . . ^ ^ , 

Figure  3-2  shows  — ■ i-  ■ „ in  terms  of  both  R/T  failures  and 
Field  MTBF 

total  field  operate  hours  by  base.  The  A MTBF  is  the  absolute  difference 
in  hours  between  the  field  and  contractual  MTBFs.  The  field  MTBF,  since 
it  is  the  best  estimate  of  performance,  is  used  in  the  denominator  to 
complete  the  ratio.  The  R/T  failures  shown  in  Figure  3-2  as  the  vertical 
axis  are  closely  associated  with  the  goodness  of  the  contractual  MTBF 
estimate  since  they  are  the  only  source  of  operate  hours  and  install 
days  that  the  contractor  has.  The  number  of  R/T  failures  is  the  same 
for  both  the  contractual  and  field  estimates.  On  the  other  hand,  the 
field  TOH  is  closely  associated  with  the  field  MTBF  estimate. 

As  can  be  seen  in  Figure  3-2,  as  the  operating-hour  experience 
increases  (and  the  number  of  failures  increases) , the  ratio  tends  to 
decrease.  Therefore,  Figure  3-2  indicates  that  the  differences  between 
computational  methods  decrease  as  operational  experience  is  accumulated. 
At  bases  where  there  are  relatively  few  operating  hours,  the  contractor 
(based  on  data  from  returned  R/Ts)  must  estimate  from  small  samples. 

Thus,  there  will  be  greater  differences  reflecting  sampling  variations. 

At  bases  where  there  are  greater  operating  experiences,  the  computational 
methods  move  numerically  closer  together.  As  more  TACANs  are  installed 
or  operating  hours  increase,  the  MTBF  differences  should  be  smaller  than 
those  shown  in  Figure  3-2. 

3.6.2  Field  vs.  Contractual  Computations  - Aircraft  Categories 

The  computational  methods  were  also  compared  after  grouping  of 
aircraft  by  type.  The  aircraft  were  categorized  as  noted  in  Table  3-2. 
Since  the  Mountain  Home  AFB  data  (F-111)  were  not  included,  for  the 
reasons  previously  noted,  the  third  category  involves  only  attack  types 
(A-7,  A-10) . Unfortunately,  the  TACAN  experiences  for  these  aircraft 
were  not  extensive  (particularly  for  the  contractual  computations,  which 
were  based  on  a sample  of  187  operating  hours  and  7 valid  returns) . 

3. 6. 2.1  APT  and  TOH  Comparison 

Table  3-5  and  Figure  3-3  present  a comparison  of  the  field  and 
contractual  estimates  of  APT  and  TOH.  Table  3-5  presents  the  ratios 
as  follows: 


APT  (Contractual 
APT  (Field) 

and 

TOH  (Contractual) 
TOH  (Field) 


r ^ 


The  basic  data  were  drawn  from  AOT  and  TOH  computations  shown  in  Table 
3-2  and  reproduced  in  Table  3-5  for  the  convenience  of  the  reader.  The 
ratios  of  Table  3-5  are  computed  from  those  values.  As  for  the  base- 
level  compeurisons,  a ratio  of  1.0  would  indicate  that  the  AOT  and  TOH 
field  and  contractual  estimates  were  identical  (no  differences) . As  with 
the  base-level  comparison,  there  are  differences  between  computational 
approaches  due  to  differences  in  the  data  upon  which  the  estimates  are 
based.  As  more  operating  hours  are  accumulated,  there  are  more  unit 
returns  on  which  the  contractor  bases  his  estimates.  We  should  there- 
fore expect  to  see  closer  agreement  between  the  field  and  contractual 
estimates  as  the  operating  hours  increase. 

The  results  shown  in  Figure  3-3  indicate  convergence  between  AOT 
and  TOH  estimates  as  operating  hours  are  accumulated.  As  the  data  base 
increases  (more  hours  and  subsequently  more  returns) , the  contractor 
is  in  a better  position  to  estimate  actual  field  performance. 

3. 6. 2. 2 MTBF  Comparison 

Differences  in  the  field  MTBFs  and  contractually  estimated  MTFBs 
were  also  indicated  (Tcible  3-2).  In  one  case  (AttacJc  category)  the 
contractual  MTBF  is  lower  than  the  field  equivalent.  In  the  other  two 
categories  (Trainer  and  Heavy  Platform)  the  contractual  MTBF  (Set) 
is  higher  than  the  field  value. 

Table  3-6  presents  MTBF  percentage  differentials  for  MTBF  by  Air 
Force  Base  and  consolidated  by  aircraft  categories.  It  shows  that 
percentage  differentials  by  laase  scored  as  high  as  71.9  percent.  The 
Trainer  category  differentials  obtained  by  consolidating  the  bases  was 
only  17.8  percent. 

The  Heavy  Platform  differentials  ranged  from  a low  of  10  percent 
up  to  188  percent.  The  consolidated  differential  was  20.9  percent. 

The  attac)c/f ighter  differential  was  handicapped  by  a lac)c  of  failure 
experience.  The  consolidated  differential  in  this  case  was  also  the 
base  figure  since  Davis-Monthan  was  the  only  base  with  return  data. 

Figure  3-4  is  a plot  of  A MTBF  Hours/Field  MTBF  in  terms  of  both 
R/T  failures  and  total  operate  hours  by  aircraft  categories.  The 
interpretation  of  Figure  3-4  is  the  same  as  for  the  base  level  (Figure 
3-2).  As  can  be  noted  in  Figure  3-4,  the  greater  the  accumulation  of 
operating  experiences,  the  smaller  the  percentage  difference  between 
computational  methods.  As  the  operate-hours  for  each  category  increase, 
the  computational  methods  converge.  As  more  TACANs  are  installed  and 
more  operate  hours  are  generated,  the  MTBF  differences  between  the 
computational  methodologies  should  be  smaller  than  those  shown  in 
Figure  3-4. 
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Table  3-6.  MTBF  PERCENT  DIFFERENTIALS  BY  AIRCRAFT  CATEGORY 




Air  Force  Base 

Aircraft 

Type 

Percent  Difference 
MTBF 

Field  - Contractual 

Percent  Difference 
MTBF 

Field  - Contractual 

Trainer 

Laughlin 

T-38 

71.9 

1 

17.8 

Randolph 

T-38,  T-39 

32.7 

Reese 

T-38 

15.3* 

Heavy  Platform 

Andrews 

VC-137 

No  contractual 
computations  - 
No  returns 

20.9 

Castle 

B-52,  KC-135 

36.0 

Carswell 

B-52 

188.0 

Little  Rock 

C-130 

10.0 

March 

b-52 

25.3* 

Attack/Fighter 

Davis-Monthan 

A-7,  A-10 

39.9* 

39.9* 

England 

A- 7 

No  contractual 
computations  - 
No  returns 

Mountain  Home 



F-111 

No  contractual 
computations  - 
No  returns 

♦Contractual  MTBF  differential  less  than  the  field  value. 

3.6.3  Grand  Total  Comparison 


1 


t, 


t 


When  all  data  are  consolidated  (Teible  3-3) , the  AOT,  TOH,  and  Set 
MTBF  cire  as  follows: 

. The  difference  between  field  and  contractual  AOTs 
is  0.0954  hours.  The  percentage  of  difference  is 
less  them  6 percent: 

0.0954 

1.6290 

. The  difference  between  field  and  contractual  TOHs 
is  slightly  over  24,000  hours.  The  percentage  of 
difference  is  approximately  12  percent: 

24103.4 

195296.6 

. The  6 percent,  12  percent,  and  12  percent  values  are 
within  the  ranges  that  could  be  expected  from  a 
sampling-type  approach.  Thus  it  is  concluded  that 
the  contractual  methods  are  satisfactory  estimates 
of  field  performance. 

3.7  TREND  ANALYSIS 

During  the  October  1977  field  trips,  it  was  not  possible  to  collect 
operating  time  data  (ETI  readings)  that  would  reflect  incremental 
monthly  operating  hours.  Since  the  ETI  meter  is  a cumulative  mechanism, 
readings  during  the  field  visits  represented  cumulative  operating  times. 
If  the  data  could  have  been  collected  in  such  a fashion,  it  would  have 
been  possible  to  present  comprehensive  trends  in  AOT,  TOH,  and  MTBF 
over  the  TACAN  field  implementation  period. 

It  is  possible,  however,  to  malce  several  comparisons  by  using 
the  data  in  References  1 through  5.  These  reports  were  prepared  under  a 
previous  study  of  the  AN/ARN-118 (V)  — primarily  during  the  lOT&E 
program  for  that  equipment. 

Table  3-7  summarizes  TACAN  field  and  contractual  computation 
results  for  the  initial  six  months  of  AN/ARN-118 (V)  field  operations. 
Equivalent  contractual  computations  are  also  shown  for  the  reporting 
periods  indicated.  The  total  consolidated  results  from  the  October 
1977  field  visits  (also  shown  in  Table  3-3)  are  reproduced  in  Table 
3-7  for  comparison  purposes. 


J 


3-30 


As  can  be  seen  in  Table  3-7,  there  is  a general  trend  toward 
closing  of  differentials  between  the  October  1977  data  set  and  the 
January-June  1976  results.  For  example,  the  AOT  differential  between 
field  and  contractual  computations  is  approximately  0.1  hour  as  compared 
with  0.5  to  more  than  1.0  hour  for  previous  months.  The  MTBFs  also 
exhibit  a similar  trend. 

Since  the  basic  populations  for  each  data  set  are  increasing, 
the  differentials  between  the  initial  program  months  and  the  October 
data  can  be  better  seen  in  Figures  3-5,  3-6,  and  3-7.  Figure  3-5 
presents  the  differences  between  field  and  contractual  AOT  computations. 
For  example,  in  January-February  1976  there  was  a difference  of  36 
percent,  computed  as  follows: 

1.955  AOT  (contractual  computation) 

1.441  AOT  (field) 

0.514  hour  -f  1.441  = 0.36,  or  36  percent 

NOTE:  The  field  AOT  for  the  initial  months  was  computed 

from  the  average  number  of  installs  in  the  reporting 
period,  days  in  the  period  and  operating  hours 
reported  by  the  field.  The  January-October  1977  AOT 
was  based  on  actual  readings  of  install  times  and 
ETIs. 

Percentages  ranged  from  26  percent  to  79  percent  over  the  initial 
reporting  periods.  In  contrast,  the  final  differential  based  on  October 
field  readings  was  only  6 percent. 

Figure  3-6  shows  TOH  percentage  differences  between  computational 
methods.  The  ratios  in  the  initial  months  are  relatively  constant. 

Again,  however,  there  is  a large  drop  in  the  January  1976  - October  1977 
value.  The  percentage  differences  for  the  TOH  during  the  initial 
months  ranged  from  37  percent  to  66  percent.  The  final  differential 
ratio  dropped  to  12  percent. 

Figure  3-7  shows  MTBF  percentage  differences  between  computational 
methods.  The  ratio  for  the  Set  MTBF  during  the  initial  months  ranged 
from  37  percent  to  66  percent.  The  ratio  for  the  final  reporting  period, 
however,  dropped  to  only  12  percent. 

The  dramatic  decreases  in  contractual-to-f ield  ratios  for  AOT, 

TOH,  and  MTBF  between  reporting  periods  strongly  suggest  that  the 
contractual  computations  are  converging  with  field  computations  as 
actual  field  usage  increases. 
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Figure  3-7.  SET  MTBF  COMPARISON 


IMPACT  - FIELD  VS.  CONTRACTUAL  COMPUTATIONS 


The  production  contract  for  the  AN/ARN-118 (V)  TACAN  contains 
provisions  for  evaluation  of  the  manufacturer's  performance.  To  verify 
achievement  of  contractual  goals  and  make  appropriate  contract  price 
adjustments,  it  is  necessary  for  both  the  manufacturer  and  the  Air 
Force  to  collect  Icirge  quantities  of  data.  These  data  will  be  used  to 
quantify  the  following  contract  performance  and  price-adjustment 
factors : 

. Mean  time  between  failures  (MTBF) 

. Consignment  spares 

. Liquidated  damages  for  turnaround  time  delay 
. Factor  for  lost  units 

. Adjustment  for  an  operating  hour  differential 
. Charge  to  government  for  excessive  unverified  failures 


3.8.1  AOT  Impact 


Only  three  of  the  above  adjustment  factors  are  germane  to  this 
particular  study.  These  factors  are; 


. Adjustment  for  an  operating  hour  differential 
. Mean  time  between  failures  (MTBF) 

. Consignment  spares 

The  adjustment  for  an  operating  hour  differential  will  be  initially 
considered  based  on  the  results  of  the  ARINC  Research  field  data 
collection. 


The  pricing  of  the  RIW  provision  is  based  on  an  average  operating 
time  of  68  hours  per  month  for  installed  R/T  units.  The  contract 
provides  that  the  price  shall  be  adjusted  to  account  for  significcint 
deviations  (greater  than  plus  or  minus  5 percent)  from  the  68-hour 
standard.  The  readings  of  R/T  units  returned  during  the  preceding  12 
months  are  used  to  estimate  total  operating  time.  This  estimate  is  compared  with 
the  expected  average  operating  time  of  68  hours  per  month.  The  first 
adjustment  period  will  be  16  April  1977  to  16  April  1978,  and  adjustments 
will  be  made  every  12  months  thereafter. 

Since  the  adjustment  period  is  still  in  the  future  at  the  time 
of  the  document,  computation  will  be  hypothesized  based  upon  the  ARINC 
Research  field  AOT  (1.6290  hours/install-day).  It  is  assumed  for  this 
computation  that  this  AOT  value  will  be  the  same  that  the  contractor 
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will  use  to  assess  operating  hours  over  the  16  April  1977  to  16  April 
1978  period.  Further  assume  that  the  average  monthly  number  of  installs 
over  this  period  will  be  1500  TACANs. 

The  anticipated  average  operating  time  (AOT)  per  the  contract 
is  as  follows: 


Tgg  = R/T  operating  time  over  the  12  month 
period  based  on  a 68  hour-per-month 
average 

= 12  months  X 68  hours/month  X 1500  average  installs 
= 1,224,000  hours 

T^Ti  ~ estimated  R/T  unit  operating  time  based 
on  the  field  AOT 

= 1.6290  hours/install-day  X 365  days/yr  X 
1500  average  installs 

= 891,877.5  hours 

The  operating-time  price  adjustment  is  then  calculated  as  follows: 

If  0.95  T > T < 1.05  T^q,  there  would  be  no  adjustment. 

DO  — ETI  — 68 

For  T < 0.95  T , the  downward  price  adjustment  would  be 
ETI  68 

equal  to  $0.50  X [(0.95  X T ) - T ],  with  a downward  limit 

68  ETI 

of  $200  X N for  any  12-month  period. 

For  T >1.05  T the  upward  price  adjustment  would  be 
ETI  68 

equal  to  $0.50  X [t  - (1.05  X T_„)]. 

ETI  68 

In  this  example,  equals  891,877.5  hours  which  is  less  than 

0.95  T,--;  therefore  a price  adjustment  would  be  computed  as  follows: 

DO 

$0.50  X [(0.95  X T^„)  - T„„^]  with  a downward  limit  of 
68  ETI 

$200  X N for  any  12  month  period. 

= $0.50  [1,162,800  - 891,877.5] 

= $135,461.25*  decrease  in  contract  price 

*N0TE:  This  is  hypothetical  only.  It  is  based  on  the  assumptions 

noted  previously. 


3-35 


If  the  contractual  value  for  AOT  (1.7244  hours/install-days)  had 
been  used  there  would  have  been  a smaller  decrease  in  contract  price 
(i.e.,  less  advantage  to  the  USAF) . 

T = 1,224,000  hours 
68 

~ 1,7244  hours/install -day  X 365  days/yr  X 1500  average  installs 
= 944,109  hours 
$0.50  [(0.954  Tgg)  - 

= $0.50  [1,162,800  - 944,109] 

= $109,345.50  decrease  in  contract  price. 

3.8.2  MTBF  Impact 

The  manufacturer  guarantees  that  each  type  of  nomenclature  unit  or 
line-replaceable  unit  (LRU)  will  achieve  a mean  time  between  failures 
(MTBF)  such  that  the  TACAN  set's  MTBF  is  equal  to  or  greater  than  the 
following  values: 


Period  1 
Period  2 
Period  3 


Calendar  Periods  MTBF 

17  April  1977  - 16  Aoril  1978  500  hours 
17  April  1978  - 16  April  1979  625  hours 
17  April  1979  - 16  April  1981  800  hours 


The  contract  was  awarded  on  16  July  1975.  The  calendar  periods 
listed  above  are  based  on  the  following:  33  months  after  award  of 
contract  (MAC)  (end  of  period  1) , 45  MAC  (end  of  period  2) , and  69  MAC 
(end  of  period  3).  For  the  guarantee  evaluation,  MTBF  is  defined  as 
the  total  operating  hours  that  were  accumulated  during  the  period  by  all 
TACAN  sets  in  the  active  government  inventory  divided  by  the  total 
number  of  relevant  verified  failures  of  all  such  sets  during  the  period. 
The  contract  provided  for  computing  the  MTBF  every  six  months,  with  the 
initial  computation  covering  the  period  16  April  1977  through  16 
October  1977. 

As  was  noted  in  Table  3-3,  the  set  MTBF  using  as  a basis,  either 
the  field  or  contractual  values  was  well  in  excess  of  all  the  MTBF 
objectives  including  the  Period  3 target  of  800  hours. 
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3.8.3  Consignment  Spares 


The  contract  provides  that  in  the  event  a unit's  (LRU)  measured 
MTBF  is  shorter  than  the  guaranteed  unit  MTBF,  the  contractor  shall 
furnish,  at  no  additional  cost,  pipeline  unit  spares  according  to  the 
following  formula: 

n = (AXS)  - Sp,  rounded  to  next  highest  whole  number 


where 


n = maximum  number  of  consignment  spares 
Sp  = quantity  previously  loaned  and  retained  by  the  government 
A = calculated  number  defined  as  follows: 

Q 

A = — - 1 (if  greater  than  1.0,  A shall  be  redefined  to  be  equal) 
to  1.0;  if  negative,  A shall  be  redefined  to  be  zero) 

G = guaranteed  MTBF  value  for  the  unit 

M = measured  unit  MTBF 

S = a target  spares  level  based  on  the  percentage  of 
the  average  number  of  installed  sets  over  the 
measurement  period.  S is  defined  to  be  equal  to 
P X N,  where  P is  as  specified  below  for  each  of 
the  nomenclatured  units : 


Unit 

Percentage  P 

R/T 

15.3 

Converter 

6.0 

Control 

2.6 

Mount 

2.5 

The  contract  provides  that  the  consignment-spares  adjustment  shall 
be  computed  for  the  same  periods  as  the  MTBF  calculations.  The  first 
computation  will  therefore  cover  the  period  17  April  1977  through 
16  October  1977,  and  computations  will  be  made  every  six  months  there- 
after. 


The  following  computation  is  used  to  illustrate  the  potential 
impact.  For  this  illustration  the  field  MTBFs  noted  in  Table  3-3 
will  be  used  (CAUTION:  the  contractor  bases  his  assessment  on  all  R/T 


returns  from  all  bases.  The  values  used  in  this  example  are  only 
for  the  ARINC  Research  field  sample  for  the  period  1 January  1976 
October  1977. 

The  consignment  ccxnputations  are  as  follows; 

R/T  Unit  (allocated  value  per  Collins  letter  dated  10  March 
1976  for  Period  1) 

629 

A = ^ -1=0  (equated  to  zero  if  negative) 

S = 0.153  X 1500  installs 

= 229.5  or  230  R/Ts 

n = A X S - Sp 

n = O X 230  -0=0 

No  consignment  R/Ts  are  required 

Converter  Unit  (allocated  value) 

3121 

A = Q -1  = 0 (equated  to  zero  if  negative) 

S = 0. 06  X 1500  installs  = 90  converters 
n = A X S - Sp 
n=OX90-0=0 

1 

No  consignment  converters  are  required 


Control  Unit  (allocated) 


12,106 

14858.6 


1=0  (equated  to  zero  if  negative) 


S = 0.026  X 1500  installs  = 39  controls 


n = A X S - Sp 
n=OX39-0=0 


No  consignment  controls  are  required 


Mount  Unit  (allocated  value) 

* - jMso  - 1 1 

redefined  as  1.0  in  accordance  with 
contractual  provisions 

S = 0.025  X 1500  installs  = 37.5  mounts 

n = A X S - Sp 

n = 1 X 37.5  - 0 = 37.5  or  38  mounts 

38  consignment  mounts  would  be  required 
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CHAPTER  FOUR 

ANALYSIS  OF  U.S.  AIR  FORCE  DATA 


4.1  INTRODUCTION 

As  outlined  in  the  Data  Accumulation  and  Evaluation  Plan  and 
Chapter  Two  of  this  report,  the  U.S.  Air  Force  Logistics  Commeind 
carried  out  a data  collection  program  concurrently  with  the  ARINC 
Research  data  collection  effort.  The  goal  of  this  exercise  was  to 
obtain  data  on  TACANs  that  were  installed  in  aircraft  deployed  at  Air 
Force  Bases  that  were  not  visited  by  ARINC  Research.  Based  on  the 
deployment  listing  of  2 September,  1977,  twenty-nine  (29)  Air  Force 
Bases  were  reported  as  having  118 (V)  TACAN  installs.  Of  these  bases, 
eleven  (11)  were  visited  by  ARINC  Research;  it  is  the  balance  of  those 
bases  (eighteen  (18))  that  was  docxmiented  by  the  AFLC  data  collection. 

The  forms  used  in  the  data  collection  were  the  same  Data  Collection 
Forms  as  developed  and  used  by  ARINC  Research  and  AFLC/LOM.  The  data 
forms  were  distributed  by  AFLC  with  instructions  regarding  their  com- 
pletion and  were  to  be  returned  to  AFLC/LOM.  After  a review  of  the  data 
by  AFLC/LOM,  the  information  was  then  sent  to  ARINC  Research. 

This  chapter  discusses  the  completeness  and  quality  of  the  data 
so  obtained  by  the  Air  Force.  It  also  provides  estimates  of  AOT,  TOH, 
and  MTBFs  of  the  TACAN  LRUs  and  set.  Attached  as  Appendix  D,  U.S.  Air 
Force  Data,  are  the  information  that  was  provided  to  ARINC  Research  by 
AFLC. 

4.1.1  Reception  of  Air  Force  Distributed  Data  Forms 

As  relayed  through  correspondence  with  AFLC/LOM,  the  majority  of  the 
Air  Force  Bases  not  visited  by  ARINC  Research  responded  to  the  AFLC 
request  for  data.  These  data  were  received  by  ARINC  Research  and  were 
analyzed  as  time  and  resources  permitted.  The  following  Air  Force  Bases 
responded  to  the  collection  activity: 
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Air  Force  Base 


Aircraft 


7 


Type 


Number  of  TACANs  Read 


Andersen 

B-52 

14 

Bcirksdale 

B-52 

5 

Blytheville 

B-52 

5 

Columbus 

T-38 

115 

Dyess 

C-130/B-52 

54/16 

Edwards 

A- 10 

2 

Elgin 

F-111 

1 

Fairchild 

B-52 

5 

Grand  Forks 

B-52 

3 

Minot 

B-52 

2 

Nellis 

A-10 

1 

Sawyer 

B-52 

4 

Upper  Heyford 

F-111 

102 

Vance 

T-38 

55 

Williams 

T-38 

97 

Wurtsmith 

B-52 

5 

A total  of  457  TACAN  readings  were  obtained  through  this  data 
collection  effort.  It  is  assumed  that  all  of  the  information  returned 
in  this  manner  reflected  dates  as  contained  in  the  TCTO  documents  for 
the  particular  aircraft.  The  data  returned  were  purported  to  be  the 
total  number  of  TACANs  installed  at  each  AFB.  As  a consequence,  these 
data  did  not  require  extrapolation  to  account  for  missing  TACAN  reads 
as  was  done  in  Chapter  Three. 

4.1.2  Quality  of  Data 

A basic  premise  of  the  data  collection  was  that  ARINC  Research  data 
were  collected  from  aircraft  that  were  representative  of  the  U.S.  Air 
Force  fleet  as  a whole.  The  data  collected  by  ARINC  Research  required 
the  correction  of  much  of  the  install  day  information.  These  corrections 
were  done  at  the  Air  Force  bases  during  observation  of  the  TACAN 
warranty  data  cards.  ARINC  Research  did  not  participate  in  the  Air 
Force  submitted  data  collection  effort.  As  a consequence,  ARINC  Research 
could  not  verify  (at  the  source)  data  such  as  the  install  dates.  The 
Air  Force  submitted  data  may  also  reflect  the  hidden  data  discrepancies. 
The  Air  Force  computation  that  follows  is  therefore  shown  only  as  an 
illustration. 


1 

J 

1 

1 


J 
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4.2  ANALYSIS  OF  USAF  DATA 


i 

i 

[ 


4.2.1  Preliminary  Analysis 

As  it  was  received  by  ARINC  Research,  the  USAF  data  were  analyzed 
by  ARINC  Research  for  completeness  and  quality.  Accordingly,  basic 
calculations  of  elapsed  time,  installed  days  and  whenever  possible, 
total  flight  hours  were  made.  In  order  to  accomplish  the  ETI  calcu- 
lations it  was  necessary  to  obtain  the  ETI  hours  at  Collins  shipment  for 
each  of  the  TACANs  reported  by  the  Air  Force.  This  was  accomplished 
for  some  457  aircraft. 

4.2.2  Calculation  of  Statistics 


The  USAF  data  were  analyzed  using  the  field  method  of  calculations 
for  ACT  and  TOH  from  the  data  as  contained  in  Appendix  D.  MTBFs  were 
computed  using  data  from  Appendix  D and  failure  information  taken  from 
the  contractor  data  logs.  While  the  analysis  process  was  similar  to 
the  methods  used  in  the  earlier  analysis  of  ARINC  Research  data  (i.e., 
the  use  of  correction  factors  and  quality  judgements)  it  was  performed 
only  as  illustration  information  due  to  the  reservations  noted  previously 

Table  4-1  presents  the  results  of  a computation  using  the  USAF 
submitted  data. 

Lines  1 and  2 of  the  table  present  the  summarizations  of  ETI 
operating  hours  and  install  days  from  the  sixteen  (16)  reporting  bases. 
Since  the  data  submitted  were  purported  to  be  all  installs  at  each  base 
it  was  not  necessary  to  extend  the  data  to  reflect  TACANs  that  were  not 
read.  THE  USAF  submitted  data  were  adjusted  (extended)  however,  to 
account  for  an  occasional  missing  entry. 

Lines  3 and  4 of  the  table  present  summarizations  of  the  ETI  hours 
and  install  days  taken  from  failed  R/Ts  returned  to  the  manufacturer. 

As  with  the  ARINC  Research  collected  information,  these  data  were 
extended  to  reflect  missing  information. 

Line  5 presents  the  ACT  computation  level  upon  the  USAF  submitted 

data. 


Line  6 presents  the  ACT  contractual  computation  based  only  upon  the 
returned  unit  data. 

Line  7 presents  the  TOH  developed  from  the  US  Air  Force  submitted 
information. 
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Table  4-1.  USAF  DATA  STATISTICS 


1.  Z field  ETI 


2.  Z field  Installed  Days 


118,306 


87,304 


6878.0 


4. 


Z ETIs  for  returned  R/Ts  (extended)  ' 

Z Install  days  for  returned  R/Ts  (extended)  5687.0 

I field  ETI  ■»  Z returned  unit  (extended)  ETIs 


AOT  field 


Z field  Installed  days  t Z returned  units  (extended) Install 

Days 


118306.0  + 6878.0  125184 


87304.0  + 5687.0  92991.0 


= 1.3462  hr s/install-day 


AOT  Contrac- 
tual 


Z ETIs  for  returned  R/Ts 

Z Install  days  for  returned  R/Ts 


3514 

2994.0 


1.1737 


7.  TOH  field  = Z field  ETI  + Z returned  R/Ts  (extended)  » 125184.0 
TOH  Contractual  = N x AOT  x D = 111,161.1 

8.  Returned  LRU  Data 


Classification 

LRU 

RT 

MT 

C 

MX 

Verified  Failure 

72 

4 

11 

22 

Non-Verif ied 

8 

4 

1 

6 

Exclus ion 

3 

1 

21 

5 

9.  Field  (AF  Submitted  data)  Contractual 


MTBF 

(hours) 

MTBF  (hours) 

RT 

1738.7 

RT 

1543.9 

m 

31296.0 

MT 

27790.3 

c 

18744.3 

C 

13967.4 

MX 

5690.2 

MX 

5052.8 

SET 

1195.9 

SET 

1049.1 

Line  8 in  the  table  summarizes  the  failure  data  taken  from 
contractor  documents  for  the  sixteen  (16)  Air  Force  Bases  reporting. 


Line  9 in  the  table  summarizes  MTBF  computations  based  upon  the 
data  submitted  by  the  bases,  and  failure  information  is  noted  in 
Line  8. 

4.3  SUMMARY  - USAF  SUBMITTED  DATA 

The  computational  results  noted  in  Section  4.2  have  been  provided  to 
show  the  statistics  of  Air  Force  siabmitted  data. 

These  data  were  submitted  by  the  Air  Force  and  were  not  subject  to 
quality  control  review  at  the  source  by  ARINC  Research  as  were  the  data 
noted  in  Appendix  B. 

.In  order  to  assist  other  analysts  who  may  wish  to  use  the  data  in  the 
future,  the  basic  data  submitted  by  the  USAF  were  prepared  as  follows: 

. The  basic  data  were  transferred  to  the  format  of  Appendix  D 
and  typed. 

. The  ETI  hours  at  ship  were  developed  from  the  manufacturer's 
data  logs  and  entered  into  the  Appendix  D. 

. The  AetIs  were  computed  as  noted  in  Appendix  D. 

. The  Alnstall  Days  were  computed  and  entered  into  Appendix  D. 

. A Flying  Hours  were  computed  and  entered. 

An  illustrative  computation  was  performed  as  seen  in  Section  4.2. 

4.4  COMBINATION  OF  ARINC  RESEARCH  FIELD  AND  USAF  SUBMITTED  DATA 

Much  of  the  install  day  data  collected  by  ARINC  Research  required 
correction.  Since  ARINC  Research  did  not  participate  in  the  AF  submitted 
data  collection,  effort,  it  is  not  known  whether  the  AF  submittals 
contain  similar  errors.  For  the  sake  of  discussion,  both  ARINC  Research 
and  USAF  submitted  data  have  been  combined  to  develop  an  overall  assess- 
ment. It  should  be  pointed  out  that  the  net  result  may  not  be  valid  for 
the  reasons  noted.  Care  should  be  taken  in  interpretation  of  the  combined 
results.  Table  4-2  summarizes  the  results  generated  by  combining  ARINC 
Research  field  and  USAF  submitted  data. 

As  can  be  seen  in  Table  4-2,  differences  exist  in  the  number  of 
ETI  hours  and  install  days  for  each  population.  Aside  from  consideration 
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of  data  errors,  differences  could  be  expected  due  to  the  fact  that 
statistics  were  developed  from  different  populations.  It  will  be  noted 
that  the  ARINC  Research  collection  developed  75,000  more  ETI  hours 
(195,296.6  vs.  125,194.0)  than  the  USAF  submitted  information.  This 
was  true  although  only  eleven  (11)  bases  were  visited  versus  the  other 
sixteen  (16)  reporting  activities.  This  reflects  an  earlier  observation 
concerning  high  density  bases  selected  by  ARINC  Research.  The  AOT 
difference  between  populations  appears  high  (1.6290  vs.  1.3462  or  17.4%) 
particularly  in  light  of  the  small  differential  between  the  ARINC 
Research  field  sample  and  contractual  value  (6%)  noted  previously.  Part 
of  the  AOT  difference  may  be  due  simply  to  population  characteristics. 
The  install  day  data  collected  during  the  ARINC  Research  field  visits 
was  obtained  only  after  a correction  effort. 

Install  day  errors  may  be  present  in  the  USAF  submitted  data.  This 
might  also  account  for  part  of  the  difference  between  AOT  computations. 
The  MTBFs,  despite  obvious  differences  in  population,  are  remarkably 
close  (e.g.  set  MTBF  1204.5  vs.  1195.9). 

In  general,  results  obtained  using  the  USAF  submitted  data  are 
numerically  lower.  The  combined  values,  as  noted  in  Table  4-2,  lie 
between  the  two  population  sets. 
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Table  4-2.  COMBINED  ARINC  RESEARCH  AND 

USAF  SUBMITTED  DATA 

ARINC  DATA 

USAF  SUBMITTED 

COMBINED 

1. 

EETIS 

= 195,296.6 

hours 

+ 

125,184.0 

hours 

320,480.6 

hours 

2. 

Elnstalled 

Days 

= 119,887.1 

days 

+ 

92,991.0 

days 

212,878.1 

days 

3. 

AOT 

= 1.6290 

hrs/install~day 

1.3462 

hrs/ install-day 

1.5055 

hrs/install-day 

4. 

TOH 

= 195,296.6 

hours 

+ 

125,184.0 

hours 

320,480.6 

hours 

5. 

MTBF  (Hours) 

= 

RT 

= 1,914.7 

1,738.7 

1,841.8 

MT 

= 48,824.2 

31 ,296.0 

40,060.1 

C 

= 14,858.6 

18,744.3 

16,237.4 

MX 

= 4,541.8 

5,690.2 

4,930.5 

Set 


1,204.5 


1,195.9 


1,201.5 


CHAPTER  FIVE 

ARINC  RESEARCH  FIELD  AND  OTHER  QUALITATIVE  OBSERVATIONS 


5.1  INTRODUCTION 

This  section  will  discuss  the  activities  of  ARINC  Research  during 
its  TACAN  data  collection  trips  to  Collins  and  to  Air  Force  bases  in 
the  period  of  2 through  21  October  1977 . The  facts  and  observations 
presented  within  this  chapter  were  prepared  as  a summary  of  project 
events.  Therefore,  the  section  will  present  qualitative  observations 
of  events  and  general  discussions  of  data  taken. 

5 . 2 SCHEDULE 

The  scheduled  period  of  field  TACAN  data  collection  was  from  2 
October  through  21  October,  1977.  With  the  exception  of  several  minor 
variations,  the  planned  and  actual  scheduling  were  as  presented  in  the 
Data  Accumulation  and  Evaluation  Plan  (Appendix  A) . 

5.3  WARRANTY  CARD  DOCUMENTATION 

An  important  aspect  of  the  AN/ARN-118 (V)  TACAN  warranty  is  the 
proper  documentation  of  the  Warranty  Data  Card  that  is  physically  placed 
on  the  front  of  the  R/T  1159  A.  This  is  the  medium  by  which  the  Air 
Force  and  Collins  Avionics  calculate  the  installed  days  of  the  TACAN  and 
the  elapsed  time  that  has  been  accrued  since  its  installation  in  the 
aircraft.  These  pieces  of  information  are  key  elements  in  the  calculation 
of  MTBF  for  the  TACAN. 

The  warranty  card  must  be  documented  in  the  following  manner: 

(1)  The  date  of  install  must  be  entered  at  the  time  of  install, 
and  in  the  format  of  month/day/year . 

(2)  The  removal  date  should  also  be  recorded  on  the  tag  at  the 
time  of  the  TACAN  removal , and  in  the  same  format  as  described 
above. 

(3)  The  serial  number  of  the  R/T  must  be  entered  on  the  card  in  the 
space  provided  in  the  upper  right  hand  side. 
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(4)  All  entries  are  to  be  made  in  ink  only. 


r 


The  following  observations  were  made  with  regard  to  the  above 
procedures ; 

5.3.1  Install  Data  Information 

The  installed  dates  were,  for  the  most  part,  either  incorrectly 
entered,  or  entered  with  pencil  or  felt  tip  ink.  The  percentage  of 
incorrect  entries  has  been  estimated  to  be  better  than  60%.  Of  the 
incorrect  entries,  the  most  common  method  of  formatting  the  information 
was  day/month/year.  In  cases  such  as  in  an  example  date  of  01/12/76, 
it  was  very  difficult  to  tell  if  the  date  was  the  12th  of  January,  1976, 
of  the  1st  of  December,  1976.  in  such  situations,  or  in  the  event  of 
no  install  date  whatsoever,  a print-out  was  usually  obtained  from  the 
AF  Base's  Job  Control  Section,  listing  dates  of  TCTO  compliance.  Whenever 
it  was  appropriate,  the  corrected  install  date  would  be  entered  on  the 
card,  or  the  TCTO  compliance  date  would  be  written  in.  Other  variations 
on  the  format  existed,  for  example,  3 Oct  77,  or  29/3/77.  In  either  case, 
it  is  doubtful  that  a mistaken  date  could  be  assumed,  due  to  the  written 
out  month,  or  the  obvious  fact  of  there  not  being  a 29th  month.  However, 
when  it  was  felt  to  be  necessary,  (i.e.,  pencil  entries)  such  entries 
were  changed  to  the  correct  format. 

5.3.2  Removal  Dates 


The  great  majority  of  TACANs  that  had  been  removed  for  maintenance 
did  have  the  removal  date  entered.  When  this  was  not  the  case,  internal 
documents  were  consulted  to  determine  on  the  Data  Card  the  date  of 
removal.  A more  serious  problem  surfaced  in  the  area  of  determining 
the  proper  time  to  enter  the  removal  date.  If  a TACAN  were  removed  for 
failure  verification,  in  some  instances,  the  removal  date  would  not  be 
entered  until  the  bench  testing  was  accomplished.  In  some  cases,  it  was 
understood  that  several  days  might  pass  from  the  time  of  removal  to 
the  time  of  verification,  thereby  crediting  the  TACAN  with  several  extra 
installed  days.  In  such  situations,  the  AF  Bases  were  advised  to  record 
the  removal  date  at  the  time  (day)  of  removal.  If  a Cannot  Duplicate 
(CND)  condition  were  found  to  exist,  the  date  of  install  should  be 
entered  at  installation,  regardless  of  the  fact  that  the  TACAN  might  be 
put  back  in  the  same  aircraft. 

5.3.3  R/T  Serial  Number 


The  R/T  serial  number  was  not  correctly  entered  in  a large  number  of 
TACANs.  When  this  was  the  case,  it  was  written  into  the  space  provided 
by  ARINC  Research.  Usually,  the  serial  number  was  omitted,  rather  than 
an  error  in  the  number.  On  several  occasions,  the  number  of  the  mounting 
tray  was  listed  on  the  card.  This  was,  for  some  aircraft  installs,  a 
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somewhat  natural  error  to  make  due  to  the  close  physical  proximity  of 
the  equipment  nameplaces  of  the  R/T  and  Mounting  Tray. 

5.3.4  Failure  Coding 

There  appeared  to  be  widespread  confusion  regarding  the  filling  in 
of  the  blank  for  the  "Code".  Many  individuals  had  written  in  USAF  codes, 
for  example,  800,  which  indicates  that  the  TACAN  had  been  removed  for 
other  maintenance.  Another  common  occurrence  was  that  the  TACAN  ETI 
reading  at  install  would  be  written  down  in  the  code  space. 

5.3.5  General  Remarks  Concerning  the  Warranty  Cards 

In  addition  to  the  above-mentioned  aspects  of  the  R/T  cards  (See 
Figure  5-1),  several  general  comments  should  be  made.  With  regard  to  the 
writing  ink,  a number  of  inks  were  used,  but  few  as  successfully  as  black 
or  blue  ball  pxDint.  The  other  classes  of  writing  methods  (felt  point  pen, 
pencil,  fountain  pen,  etc.)  had  a marked  tendency  to  fade  with  time,  or 
were  easily  smudged.  Whenever  these  conditions  were  encountered,  it  was 
suggested  that  ball  point  pens  be  used. 

A problem  was  discovered  when  it  became  necessary  to  write  on  the 
R/T  cards.  On  the  cards  where  no  previous  entry  had  been  made,  either 
ARINC  Research  personnel  or  escorting  military  maintenance  personnel  made 
the  correct  (by  the  TCTO  compliance  date)  entry  on  the  card.  It  was 
discovered  that  the  card  was  difficult  to  write  on.  The  ball  point  pen 
could  not,  without  some  effort,  write  upon  the  card.  Only  by  preparing 
the  card  surface  with  an  ink  eraser  could  a date  of  installation  or 
serial  number  be  easily  entered. 

There  were  no  cases  in  which  the  warranty  card  was  found  to  be 
missing  from  the  R/Ts,  nor  were  there  cases  of  damaged  cards.  The 
retaining  screws  appeared  to  be  excellent  fasteners. 

5.3.6  Spares/Mock-Up  Units 

Data  for  spares  and  mock-ups  were  taken  as  a part  of  the  data  accumu- 
lation plan. 

The  disposition  of  the  spares  in  most  cases  was  that  the  organizations  were 
authorized  one  spare,  and  had,  in  their  possession,  only  one  spare.  A 
general  feeling  of  uneasiness  was  felt  towards  this  sparing  level, 
especially  among  some  squadrons  that  had  not  yet  had  time  to  accumulate 
appreciable  operate  experiences. 

Another  observation  concerns  TACAN  units  awaiting  installation.  There 
appeared  to  be  no  standard  method  of  unpackaging  or  scheduling  for  accept- 
ance testing.  As  an  example,  at  Laughlin  AFB,  the  "to  be  installed" 
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TACANs  were  unpackaged  and  tested  for  acceptance  upon  arrival.  On  the 
other  hand  at  Andrews  AFB,  where  approximately  10  R/T  units  were  shipped 
(without  the  accompanying  converters),  the  units  were  placed  in  storage, 
awaiting  opening  and  installation  in  T-39s.  It  is  recommended  that 
Andrews  AFB  be  provided  with  the  necessary  test  equipment  and  verify  test 
at  receipt  as  is  the  practice  with  other  bases. 

Mock-up  units  were,  with  the  exception  of  Andrews  AFB,  which  has  yet 
to  have  a mock-up  set  delivered,  found  to  be  working  vjell,  and  have  gained 
acceptance  with  the  maintenance  personnel  as  being  a good,  easily  con- 
figured test  set. 

5.3.7  Packaging,  Storage  and  Transportation 

There  did  not  appear  to  be  standards  by  which  the  Maintenance 
Squadrons,  unpackaged,  stored,  or  repackaged  the  TACANs.  As  a general 
rule,  AF  Bases,  upon  reception,  unpackaged  all  received  TACAN  units  and 
immediately  performed  acceptance  testing.  In  some  cases,  the  majority 
of  TACAN  shipping  containers  were  then  either  destroyed,  or  were  used 
for  other  purposes,  with  a reasonable  number  of  containers  held  in  reserve. 

The  repackaging  of  the  TACAN  after  a confirmed  failure  was  not  felt 
to  be  a problem.  The  containers  were  felt  to  be  reusable,  and  there  were 
no  problems  encountered  in  this  area. 

The  storage  of  spare  TACANs  was  physically  located  in  all  cases  in 
the  Maintenance  Squadron  Facilities.  There  were  no  reported  problems 
associated  with  the  supply  procedures,  although  there  was  some  scattered 
concern  expressed  over  the  sparing  level.  While  the  authorization  of  one 
spare  per  AMS  was  not  felt  to  be  sufficient,  no  problems  had  been 
encountered  with  sparing  or  Collins  ability  to  ship  replacement  TACANs. 

The  transportation  of  failed  TACANs  was  not  considered  to  be  a 
problem.  Once  an  item  was  verified  as  failed,  it  was  packaged  and  sent 
to  the  transportation  facilities.  No  instances  of  "batch"  shipments  had 
been  reported,  and  the  previously  corrected  Collins  shipping  address  was 
ir!y  visible  and  understood  by  all  personnel. 
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maintenance  burden  for  equipment  up  to  50%.  They  looked  upon  the  TACAN 
as  a piece  of  equipment  that  had  virtually  eliminated  TACAN  problems  and 
t had  now  provided  them  with  an  opportunity  to  devote  more  time  to  other 

maintenance  areas. 

[ 5.4  PROBLEM  AREAS 

5.4.1  Installation  Problems 

The  only  aircraft  which  appeared  to  have  a problem  with  installation 
was  the  T-38.  Due  to  the  "sideways"  mounting  of  the  TACAN,  a problem 
, usually  occurred  during  installation  or  removal  from  the  aircraft.  A 

i bundle  of  cables  was  routed  in  the  COMM/NAV  panel  such  that  the  TACAN 

[ could  not  be  easily  positioned.  In  many  cases,  the  bundle  insulation 

f could  be  cut  by  the  mounting  tray  as  attempts  were  made  to  install/ 

[ remove  the  TACAN. 

f 

On  the  T-38,  a liquid  oxygen  fill-valve  bracket  was  also  positioned 
such  that  upon  installation  of  the  TACAN  the  Warranty  Information  sticker 
would  be  scraped  off.  Repositioning  of  the  sticker  to  the  left  by 
approximately  three  inches  would  resolve  this  problem. 

5.4.2  Damage  to  Control  Boxes 

A high  incidence  of  control  boxes  have  been  returned  to  Collins 
Avionics  with  broken  glass.  Opinions  as  to  who  or  what  phenomena  were 
responsible  for  such  a condition  varied  from  individuals  queried.  ARINC 
Research  personnel  made  inquiries  into  this  problem  and  observed  the 
following  facts  and  opinions. 

The  position  of  the  control  box  in  some  aircraft,  most  noticibly  the 
T-38s,  A- 10s  and  A-7s,  is  such  that  a breakage  could  occur  due  to  a seat 
belt  or  other  objects  falling  on  it.  For  the  T-38,  an  experiment  was 
conducted  at  Randolph  AFB  in  which  a pilot  intentionally  unbuckled  his 
various  belts  in  such  a way  as  to  test  the  seat  belt  "hypothesis".  After 
a thorough  test  (with  no  brecikage)  it  was  concluded  that  an  intentional 
seat  belt  dropping  could  not  break  the  control  box  glass.  j 

It  was  the  opinion  of  several  maintenance  crewmen  that  the  breakage 
was  due  to  abuse  by  the  maintenance  crews  who  either  carelessly  placed  or 
I dropped  their  tools  on  the  glass.  It  was  also  reported  that  breakages  , 

I occurred  due  to  using  the  area  around  the  control  box  as  a foot-step. 

Other  incidents,  especially  in  the  T-38s,  contributed  to  breakage  by  the 
I practice  of  applying  pressure  to  the  glass  while  seating  the  control  box 

' in  the  cockpit.  This  was  verified  at  Reese  AFB  by  the  actual  observance 

of  •^Mi-h  an  incident  by  military  personnel. 


5.4.3  Need  for  Accurate  Data  Recordin' 
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At  many  installations,  it  was  felt  that  there  was  an  unawareness  of 
the  need  for  accurate  data  recording.  Most  maintenance  personnel  did  not 
know  why  RIW  existed,  or  its  basic  features,  but  were  satisfied  that  the 
ARN-118  TACAN  meant  less  work  for  them.  In  no  case  was  it  discovered 
that  maintenance  personnel  were  apathetic;  rather,  they  were  found  to  be 
most  cooperative  and  receptive  to  any  concept  that  would  help  them  in 
their  work. 

5.4.4  Accelerated  Installs  Schedule 

At  England  AFB,  the  reliability  of  the  previous  model  TACAN  was  such 
that  their  flight  schedule  could  not  be  met.  Because  of  the  expected 
reliability  of  the  ARN-118,  an  order  was  issued  to  move  up  the  scheduled 
install  date  to  an  immediate  schedule.  Consequently,  66  TACANs  were 
found  to  be  installed  at  England  rather  than  the  expected  13. 

5.5  COLLINS  AVIONICS  GROUP  DATA 

As  indicated,  the  source  of  much  contractual  data  for  MTBF  and  AOT 
calculations,  as  well  as  information  regarding  non-verified  and  excluded 
returns  is  the  manufacturer  of  the  TACAN,  the  Collins  Avionics  Group  of 
Rockwell,  International.  As  such,  Collins  maintains  extensive  warranty 
logs  describing  the  just  mentioned  subjects,  and  other  topics,  such  as 
delivery  information,  installation  data,  and  summaries  of  corrective 
actions.  The  contractual  information  used  in  TACAN  calculations  is 
obtained  from  these  Warranty  Logs. 

5.5.1  Results  of  Visits  to  Collins  Avionics 

An  initial  visit  to  Collins  Avionics  was  made  on  26-28  September, 
1977,  in  order  to  obtain  Collins'  support  of  the  contractual  effort,  and 
to  relate  to  them  the  exact  details  of  the  proposed  Data  Accumulation  and 
Evaluation  Plan.  Additionally,  updated  Collins  Logs  were  obtained,  and 
were  used  to  provide  the  latest  information  on  the  following  areas: 

Log  1 Initial  Delivery  Log 

Log  2 Subsequent  Install  Delivery 

Log  2 A Subsequent  Delivery 

Log  3 Corrective  Action 

Log  8 Warranty  Population 

Log  9 Lost,  Nonrepairable,  Inactive  Units 

Log  10  Monthly  R/T  Operating  Time  Summary 

Also,  a record  of  the  Average  Number  of  Installs  (by  month) , as  provided 
to  Collins  by  the  Air  Force,  Warner  Robins  Air  Logistics  Center,  was 
obtained. 


These  logs  and  records  were  then  used  to  further  complete  the 
ARINC  Research  data  collection  forms  (most  noticeably,  the  Collins  ETI  at 
ship,  and  also,  an  accounting  of  several  previously  confirmed  failures 
was  made  to  further  clarify  the  average  number  of  installs  by  month) . 

5. 5. 1.1  Comparison  of  Field  Data  to  Collins  Data 

The  major  point  of  interest  with  regard  to  ciny  comparison  of  the  two 
data  sets  is  in  the  area  of  failed  units  and  their  return  to  Collins. 
Although  all  of  the  Bases  visited  had  TCTO  print-outs  showing  the  data 
of  compliance  and  aircraft  for  which  the  Technical  Order  was  complied, 
no  official  records  have  been  kept  with  respect  to  failed  TACANs. 
Therefore,  the  Collins  record  is  the  only  reliable  source  of  information 
with  respect  to  the  number  of  failures  by  LRU. 

5. 5. 1.2  Trip  of  7-9  November 

A second  trip  to  Cedar  Rapids  was  made  on  the  above  date  in  order  to 
discuss  with  Collins  the  data  collection  effort  of  the  previous  month, 
and  to  further  update  the  information  contained  in  the  Collins  Logs , 
especially  Logs  1,  2,  2A,  and  3. 


This  latter  updating  is  particularly  important  in  light  of  the  fact 
that  additional  installs,  subsequent  deliveries,  and  failures  have 
occurred,  not  only  since  the  first  visit  to  Collins,  but  also  since  the 
end  of  the  data  collection  effort. 
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CHAPTER  SIX 


ALTERNATE  TECHNIQUES 


Alternate  computational  techniques  were  to  have  been  developed,  if 
the  study  results  revealed  that  the  present  contractual  computational 
techniques  were  not  felt  to  be  adequate  estimates  of  field  performance. 

As  noted  in  Chapter  3,  it  was  found  that  percentage  differences 
between  the  contractual  and  field  approaches  were: 

. The  contractual  AOT  estimate  was  within  6%  of  the 
field  value. 

. The  contractual  TOH  estimate  was  within  12%  of  the 
field  value. 

. The  contractual  set  MTBF  estimate  was  within  12%  of 
the  field  value. 

As  a consequence,  of  the  above  considerations  and  the  investigations 
of  Chapter  3,  it  is  felt  that  the  contractual  estimating  techniques  are 
adequate  estimates  of  actual  field  performance.  It  should  be  noted 
that  the  contractual  estimates  (at  the  time  of  the  field  visits)  were 
based  on  less  than  200,000  total  operating  hours  (with  no  AF  Base 
having  more  than  55,000  hours)  and  102  R/T  unit  returns. 

As  was  noted  in  Chapter  3 , the  data  trends  indicate  convergence 
between  the  contractual  and  field  estimates  as  operating  usage  increases 
and  more  R/T  units  are  returned.  As  a consequence,  in  future  reporting 
periods,  the  percentage  differences  (6%  - AOT,  12%  - TOH,  and  12%  Set 
MTBH)  should  be  the  same  or  less. 

The  ARN-118(V)  TACAN  program  is  - and  will  be  in  a rapid  build-up 
phase  in  the  immediate  future.  As  a result,  there  will  be  increased 
usage  and  many  more  returned  units  upon  which  the  contractor  can  base 
his  estimates.  As  an  illustration,  consider  the  following:  in  the  six 
months  following  the  ARINC  Research  field  visits,  the  number  of  installs 
should  reach  2000  sets.  Assuming  that  the  field  AOT  (i.e.  1.6290  hours/ 
install  day)  and  the  R/T  MTBF  (i.e.  1914.7  hours)  previously  observed 
remain  the  same  we  could  expect  the  following: 


6-1 


f f 


(AOT) 

1.6290  hrs/install~day  X 180  days  X 1800  installs 
1914.7  hours 
(R/T  MTBF) 

= 276  Returned  R/Ts 

The  estimates  noted  in  Chapter  3 were  based  upon  only  102  returns.  Even 
making  allowance  for  the  fact  that  20%  of  the  R/T  returns  may  not  have 
data  - the  contractor  would  still  have  over  200  records  upon  which  to 
base  the  estimates  (or  over  twice  as  many  as  were  available  for  the 
computations  in  Chapter  3)  . 

As  a consequence  of  the  increased  usage  and  the  convergence  between 
computational  approaches,  the  AOT,  TOH  and  MTBF  differences  (6%,  12%,  12%) 
should  be  no  greater  in  future  reporting  and  probably  much  smaller. 

The  above  considerations  therefore  indicate  that  the  contractual 
computational  techniques  as  now  used  are  adequate  estimates  and  alternate 
techniques  are  not  required  for  the  TACAN  program. 

One  technique  adjustment  has  been  developed  and  is  discussed  in 
subsequent  sections  of  this  document.  This  technique,  while  not  required 
for  the  TACAN  program  with  the  planned  installation  schedule,  should  be 
used  in  future  warranty  programs. 

6.1  ALTERNATE  METHOD  - N COMPUTATION 

As  was  noted  in  Chapter  3,  the  consolidated  Total  Operating  Hours 
(TOH)  contractual  computation  (Table  3-3)  was  found  to  be  numerically 
greater  than  the  equivalent  field  observation  (219400  hours  vs.  195296.0 
hours) . Although  this  amounted  to  only  a 12%  difference  - the  following 
was  observed.  The  contractor  is  provided  (on  a monthly  basis)  by  the 
USAF,  the  total  number  of  TACAN  (ARN-118(V))  installs.  The  number  of 
installs  is  based  on  the  TACAN  installs  on  the  last  day  of  each  month 
reported.  The  contractor  uses  the  number  of  installs  (n.)  in  the  com- 
putation N (average  number  of  installs  per  month)  over  tfte  measurement 
period. 

M 

N = L n./ 

. 1 M 

1 

where : 

n.  = number  of  installs  in  the  i month 
1 

M = number  of  months  in  the  measurement  period 
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since;  TOH  = D X AOT  X N,  the  N directly  impacts  upon  the  TOH 
estimates.  If  the  N estimate  is  higher  than  the  actual 
number  of  installs,  then  the  TOH  and  subsequent  MTBs 

TOH 

(=  ■ ■ , ) will  also  reflect  higher  values. 

Failures  ^ 

6.1.1  The  Present  Estimate 

The  present  estimate  of  N,  at  least  during  an  install  buildup 
period,  tends  to  overstate  the  average  number  of  installs  per  month.  In 
the  present  approach,  the  installs  reported  as  of  the  last  day  of  the 
month  assume  that  the  units  were  installed  over  all  days  of  the  month 
in  which  reported.  As  an  illustration,  Laughlin  AFB  had  1 install  in 
May,  29  in  June,  27  in  July,  37  in  August,  8 in  September  and  9 in 
October  for  a total  install  fleet  of  111  units  at  the  conclusion  of  the 
latter  month.  These  units  were,  however,  actually  installed  in  T-38 
aircraft  over  various  days  of  each  month  - not  all  on  the  first  day  of 
the  month. 

As  a consequence,  the  N indicates  more  installs  (on  average)  over 
the  month  than  is  the  actual  case.  Subsequently,  the  TOH  and  MTBF  com- 
putation would  also  reflect  higher  values.  The  following  suggested 
approach,  would  help  moderate  the  overinflation  during  an  install  buildup 
period. 

6.1.2  Average  N Method 

The  ideal  approach  to  computation  of  N would  be  to  read  the  install 
date  of  all  equipments  to  arrive  at  an  exact  measure  of  the  average 
number  of  equipments  for  a given  reporting  period.  This  would,  of  course, 
involve  considerable  expenditure  of  manpower  and  is  probably  not  economic- 
ally feasible.  An  alternate  method  of  estimating  N which  is  relatively 
simple  to  administer  is  as  follows: 

The  average  for  each  month  is  given  by  averaging  the  number  of 
installs  for  that  month  and  the  total  at  the  end  of  the  month. 

In  general  notation,  this  would  be  represented  as  follows: 

The  average  of  each  month  is  given  by: 

n,  , + n. 
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Where; 


n^  ^ = number  of  installs  at  the  close  of  the 
previous  month 
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Then; 


= number  of  installs  at  the  end  of  the 
new  month 


“(new)  ^ 


\ ^ Vl 


n,  + n^  + n,  n + n 

= ^ 0.2  1 . , M M-1 

2 2 + •••  + 2 


= "O  "l  '^2  "m 


= Z n.  + n - n 
. , 1 o M 

1=1  ■:r~  ~ , n - n . 

2 2 = N + ( o M ) 


Thus  for  any  period: 


N,  .is  computed  from  N,  , by  adding  the  correction 
(new)  (old) 


factor : 


n - n 
o M 


Where : 


n = total  number  of  installs  at  the  beginning 

of  the  period 

n^^  = total  number  of  installs  at  the  end  of  the 

period 


M = number  of  months  in  the  measurement  period 


Illustration : 


Reporting  Period 

— ^ June  July  August 

900  installed  1000  installed  1100  installed  1200  installed 


= 1000  + 1100  + 1200 
3 mos . 


= 1100  average  installed 


N = 1100  + ( ) = 1100  - 50  = 1050 

(new)  2X3  mos. 
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Table  6-1  shows  a comparison  of  the  consolidated  (original  total) 
TOH  and  MTBFs  between  the  previous  contractual  approach  and  the 

computation.  Also  shown  is  the  Field  Computation  as  was  noted  in 
Chapter  3. 

As  can  be  seen  in  Table  6-1,  use  of  a N,  , has  resulted  in  re- 

(new) 

duction  of  the  number  of  hours  from  219,400  to  204,785.3.  The  latter 
TOH  is  now  approximately  9500  hours  over  the  field  value  or  a difference 
of  about  4.9%  (from  cibout  12%  using  the  previous  N coitputational 
approach) . The  MTBFs  shown  in  Table  6-1  are  correspondingly  brought 
into  closer  alignment  with  the  field  values. 

The  N averaging  approach,  during  an  install  buildup  phase,  brings 
the  contractual  estimate  into  closer  alignment  with  the  actual  field 
operational  experiences. 
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CHAPTER  SEVEN 


CONCLUSIONS  AND  RECOMMENDATIONS 


7.1  CONCLUSIONS 

7.1.1  Overall  Conclusions 

The  contractual  computational  methods  outlined  in  the  ARN-118(V), 

RIW  and  MTBF  Guarantee  terms  and  conditions  as  they  appear  in  Contract 
F19628-76-C-0144  are  adequate  for  estimating  field  performance  for  the 
particular  unit.  The  Set  MTBFs  are  excellent  regardless  of  the  com- 
putational approach  and  in  any  event,  currently  exceed  ultimate  per- 
formance goals. 

The  alternate  method  for  computing  N is  recommended  for  future 
programs . 

There  is  evidence  that  the  need  for  accurate  data  recording  on  the 
R/T  record  card  is  not  fully  understood  by  AFB  personnel. 

7.1.2  APT  Comparison 

The  contractual  method  of  estimating  AOT  is  adequate  for  assessing 
field  experiences.  The  AOT  differential  between  field  readings  and  the 
contractual  computation  is  6%. 

7.1.3  TOH  Comparison 

The  TOH  contractual  method  is  adequate  for  estimating  field 
experiences.  A differential  of  12%  was  noted  on  the  final  field  compu- 
tations. During  the  TACAN  build-up  phase,  accuracy  of  the  TOH  estimation 
could  be  improved  by  using  the  N averaging  technique.  The  percentage 
differential  between  contractual  and  field  TOH  values  is  reduced  to  less 
than  5%  using  the  N averaging  technique. 

7.1.4  MTBF  Comparison 

The  MTBF  contractual  method  is  adequate  for  estimating  field 
experiences.  A differential  of  12%  was  noted  between  computational 
approaches.  The  N computation  will  improve  the  accuracy  of  TOH  and 
MTBF  estimates  during  buildup  periods.  The  percentage  differential 
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between  contractual  and  field-set  MTBF  values  is  reduced  to  less  than 
5%  using  the  N averaging  technique. 

7.1.5  Field  Observations  - AFB  Data  Recording 

The  warranty  data  required  on  the  R/T  unit  record  card  were 
generally  ambiguous  or  incomplete.  The  ambiguicy  of  the  month/day/year 
sequence  of  recording  of  install/remove  data  results  in  errors  in  field 
performance  estimates 

7.1.6  Field  Observations  - Equipment  Abuse 

It  was  observed  that  the  window  of  the  TACAN  control  box  is  fre- 
quently broken  - apparently  through  carelessness  during  maintenance 
activities.  These  units  when  returned  to  the  contractor  are  "excluded" 
from  normal  RIW  repair  coverage  and  result  in  additional  costs  to  the 
government . 

7.1.7  Field  Observations  - Logistics  Handling  and  Support 

Preparation  and  return  of  TACANs  to  the  manufacturer  seemed  to  be 
handled  in  an  expeditious  manner  by  the  AF  Bases.  There  was,  for  example, 
no  evidence  of  "batching"  or  non-operable  units  sitting  in  the  maintenance 
areas.  AF  Base  personnel  expressed  satisfaction  with  the  expeditious 
manner  in  which  replacements  were  sent  by  the  manufacturer,  although  this 
could  not  be  quantified  exactly.  It  was  the  general  opinion  that  replace- 
ments were  at  the  base  in  10  - 14  days. 

There  was  concern  expressed  by  AFB  maintenance  personnel  concerning 
a generally  low  spares  inventory  (usually  one  per  base) . There  was, 
however,  no  real  evidence  of  any  hardship  being  imposed  upon  the  operators. 
Extraordinarily  high  TACAN  reliability  was  credited  by  Base  personnel 
for  avoiding  replacement  problems. 

7.1.8  Field  Observations  - Test  Specifications  and  Equipment 

The  test  procedure  and  equipment  as  now  used  by  the  AF  Bases  appears 
adequate.  With  the  exception  of  one  AF  Base  visited,  there  did  not  appear 
to  be  any  problems  nor  were  any  problems  noted  by  the  Base  personnel. 

7.1.9  Manufacturer's  Data 

The  Data  required  from  the  manufacturer  to  perform  this  study  were 
accurate  and  complete  without  exception.  Data  kept  by  the  manufacturer 
under  the  contractual  provisions,  in  addition  to  being  accurate,  were 
current  with  the  program  experiences.  It  was  noted  during  the  CAG  visits 
that  the  data  hitherto  kept  mannually  were  being  automated.  A programmer- 
engineer  has  been  assigned  to  the  project  to  ensure  that  the  automation 
is  quickly  completed  and  the  data  files  maintained.  It  was  also 
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ascertained  during  the  visits  that  RIW  program  management  were  exception- 
ally well  versed  in  details  of  the  TACAN  program,  performance  achievements 
and  problems. 

7.1.10  Differences  Between  Aircraft  Types 

Significant  differences  in  TACAN  MTBFs  between  aircraft  types  were 
noted.  Heavy  aircraft  platform  types  generally  achieve  set  MTBFs  two  to 
three  times  the  value  for  lighter  aircraft. 

7 . 2 RECOMMENDATIONS 

The  following  recommendations  are  presented  on  the  basis  of  the  field 
visits  and  computational  exercises: 

. The  present  contractual  method  of  computation  is  adequate  for 
estimating  field  performance  and  should  not  be  changed  for  this 
program. 

In  future  RIW  programs,  the  method  of  computing  N should  be 
revised  to  reflect  the  averaging  of  monthly  installs. 

Each  AF  Base  should  be  given  a presentation  (prior  to  receiving 
the  ARN-118(V))  outlining  the  nature  and  intent  of  a warranty 
procurement.  Special  attention  should  be  given  to  emphasizing 
the  need  for  accurate  data  recording. 

. It  was  evident  from  the  field  visits  that  not  all  AF  Bases  have 
adapted  equally  well  to  the  warranty  program.  Bases  which  show 
evidence  of  unusual  operations  in  that  there  are  excessive  non- 
verified  (and/or  exclusions)  returns  and  poor  data  recording 
should  be  assisted.  This  assistance  could  take  the  form  of 
an  educational  presentation  that  would  address  use  of  tests, 
specifications  and  equipment  as  well  as  data  requirements.  This 
program  would  be  similar  to  the  one  noted  previously,  except  it 
would  be  structured  to  help  Bases  which  already  have  the 
ARN-118(V). 

. In  TACAN  units,  such  as  the  control  box,  which  seem  to  be 
especially  susceptible  to  damage  in  handling,  a design  change 
strengthening  the  control  box  window  should  be  considered. 

. Since  achieved  MTBF  differs  by  aircraft  types,  careful  considera- 
tion must  be  given  in  predicting  future  aircraft  mixes  under 
RIW.  The  mix  substantially  determines  the  assessment  value 
upon  which  the  contractor  is  evaluated.  MTBF  achievement  for 
aircraft  aggregates  may  be  higher  or  lower  than  objectives 
depending  upon  the  accuracy  of  anticipated  fleet  proportions. 
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INTRODUCTION 


As  described  in  the  statement  of  work,  the  purpose  of  this  contract 
is  to  determine  the  validity  of  the  computational  techniques  for  the  MTBF 
calculations  for  the  AN/ARN-118 (V)  TACAN  contract,  F19628-75-C-0144 . 
Calculations  performed  during  the  TACAN  lOT&E  have  shown  differences 
between  the  MTBF  experienced  in  the  field  and  the  MTBF  developed  through 
the  contractual  method  of  calculation.  An  MTBF  of  771  hours  was  predicted 
by  contractual  computation  as  compared  with  544  hours  determined  from 
field  data,  or  a difference  of  41.7  percent. 

This  study  is  designed  to  determine  if  the  field  MTBF  experience  is 
diverging  from  or  converging  toward  the  contractually  calculated  numbers 
as  the  sample  size  increases  and,  if  a marked  trend  toward  disparity  is 
found,  to  develop  alternative  methods  that  will  more  accurately  predict 
the  true  MTBF  of  the  TACAN. 

Therefore,  as  a task  in  that  approach,  a Data  Accumulation  and  Evalua- 
tion Plan  has  been  developed,  and  is  contained  herein  for  approval  by 
the  Air  Force  Logistics  Command.  This  plan  presents  the  ARINC  Research 
Corporation  approach  to  the  identification  of  aircraft  types  and  numbers 
which  currently  utilize  TACANs,  the  statistical  sampling  plans  and  methods 
of  analysis  needed  to  obtain  the  data  for  these  aircraft  and  the  evaluation 
techniques  needed  for  their  interpretation. 

This  paper  is  structured  to  address  both  phases  of  the  plan,  and  is 
outlined  below: 

I - DATA  ACCUMULATION  APPROACH 

1.0  TACAN  Fleet  Description 

2.0  Data  Collection  Guidelines 

3.0  Proposed  Plan  for  Data  Collection 

4.0  Schedule  of  Travel 

5.0  ARINC  Field  Data  Collection 

6.0  Collins  Radio  Data  Collection 

7.0  USAF  Data  Collection  Program 
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II  - TACAN  DATA  EVALUATION  PLAN 

1.0  Field  Data  Analysis 


> 


'll 


2.0  Collins  Radio  Group  Data  Analysis 

3.0  Comparison  of  Actual  and  Contractual  Data 

4.0  Air  Force  Data  collection 

5.0  TACAN  Fleet  Observations 

III  - IMPACT  OF  ANALYSES 

1.0  Price  Adjustment 

2.0  MTBF  Guarantee 


PART  I - DATA  ACCUMULATION  APPROACH 


1.  TACAN  FLEET  DESCRIPTION 

As  obtained  through  AFLC/LOM,  Table  1 (as  of  2 September  1977)  shows 
the  distribution  of  installed  TACANs  throughout  the  fleet,  and  the  disposi- 
tion of  that  fleet  throughout  the  bases.  TACANs  have  been  installed  in 
1104  aircraft  in  some  9 classes  of  airplanes  at  29  Air  Force  bases. 

Of  the  TACANs  installed,  most  of  the  units  are  on  station  within  the 
CONUS,  with  only  a small  percentage  (7.8  percent)  deployed  abroad.  Due  to 
time  and  budget  constraints  of  the  program,  no  effort  will  be  made  to 
collect  data  for  non  CONUS  deployments. 

The  relative  percentage  of  the  aircraft  types  show  that  trainer, 
fighter,  attaclc  aircraft  and  txamber,  cargo  aircraft  exist  in  approximately 
a 80/20  mix,  with  the  majority  of  the  former  class  being  T-38s,  and  the 
latter  class  being  comprised  most  of  C-130s  and  B-52s. 

While  the  mixes  of  the  aircraft  types  are  such  that  the  planes  are 
dispersed  throughout  the  CONUS,  the  TACAN  population  tends  to  be  concentrated 
at  a few  bases  for  each  aircraft  type.  For  example,  the  B-52  TACAN  popula- 
tion is  spread  out  over  10  bases,  with  3 bases  comprising  roughly  50  percent 
of  the  fleet.  The  same  statement  holds  true  for  T-38s  (4  bases  with  71 
percent),  F-llls  (3  bases  with  99  percent)  and  C-130s  (1  base  with  88 
percent) . 

2.  DATA  COLLECTION  GUIDELINES 

The  time  and  budget  allocated  to  this  effort  does  not  permit  100 
percent  measurement  of  fleet  TACAN  data. 
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For  the  same  reasons,  simple  or  stratified  san4)ling  of  TACANs  are  also 
not  suitable  since  each  method  require  travel  to  nearly  all  bases,  cmd  in 
some  cases  would  require  only  limited  data  collection  (i.e.,  only  a small 
percent  of  TACANs  available  at  the  base). 

Thus,  the  data  collection  and  analysis  approach  to  be  used  in  this 
effort  may  be  stated  as  follows: 

a.  ARINC  Research  will  visit  a limited  number  of  bases  and  collect 
100  percent  of  the  TACAN  time  data  available  at  those  bases.  This 
effort  will  result  in  a conplete  set  of  data  on  a sub-population 
of  TACANs  which  can  subsequently  be  compared  with  Collins  results. 

b.  The  Air  Force,  under  the  direction  of  AFLC/LOM,  will  collect 
TACAN  data  from  sites  not  visited  by  ARINC  Research  and  will  supply 
data  which  is  at  bases  visited  by  ARINC  Research  but  was  not  avail- 
able during  the  visit.  This  information,  to  the  extent  possible, 
will  be  used  to  e^qiand  the  ARINC  acquired  data  base. 

c.  Comparisons  will  be  made  for  the  TACAN  sub-populations  comprised 
of  Collins  and  corresponding  ARINC  collected  field  data.  Com- 
parisons will  be  made  for  the  total  installed  population  depending 
upon  the  availability  of  AF  collected  data,  as  time  and  resources 
permit. 

In  selecting  the  bases  to  be  visited,  the  following  guidelines  have 
been  used: 

a.  Data  will  be  collected  from  each  type  of  aircraft  which  contains 
TACANs. 

b.  When  an  aircraft  type  is  deployed  at  several  bases,  visits  will  be 
made  to  more  than  one  base. 

c.  The  total  schedule  of  visits  will  be  developed  to  minimize  travel 
time  and  costs. 

3.  PROPOSED  PLAN  FOR  DATA  COLLECTION 

Table  2 illustrates  the  proposed  plan  for  TACAN  ETI  data  collection. 
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The  guidelines  of  section  2 were  used  to  develop  this  plan. 
Specifically: 

a.  T-38  (621  installs).  These  aircraft  are  deployed  at  7 sites. 
However,  3 sites  in  Texas  hold  296  (or  48  percent)  of  all  T-38 
installations.  It  is  felt  that  this  is  a compact  arrangement 
that  will  minimize  inter-base  travel  requirements. 

b.  F-111  (196  installs) . Significant  numbers  are  deployed  at  Mt. 

Home,  Idaho  (77),  and  Upper  Heyford,  England  (74).  Inclusion  of 
both  sites  produced  unacceptable  travel  requirements.  However, 

Mt.  Home  has  been  selected  and  these  sets  represent  39  percent 
of  all  F-111  installs. 

c.  B-52  (104  installs).  These  TACANs  are  deployed  in  rather  small 
numbers  (from  2 to  20)  at  12  sites.  The  plan  provides  for  visits 
to  the  3 most  populous  bases  (one  in  Texas,  and  two  in  California) 
which  contain  51  percent  of  the  TACAN  population. 

d.  Other  Aircraft.  For  other  types  of  aircraft,  a visit  is  made 
either  to  the  sole  base  of  deployment  (T-39,  VC-137  and  KC-135)  or 
to  the  base  of  greatest  deployment  (A-10,  A-7 , and  C-130. 

A total  of  572  aircraft  or  52  percent  of  fleet  installs  will  be  visited 
under  this  plan.  Lines  (1)  through  (5)  of  Table  2 show  other  features  of 
the  plan. 

Line  1 shows  the  total  number  of  each  type  aircraft  that  will  be 
sampled  during  the  field  visits. 

Line  2 shows  the  total  install  population  for  each  aircraft  type  as 
of  approximately  2 September  1977. 

Line  3 shows  the  percentage  of  total  installs  for  each  aircraft  type 
proposed  to  be  sampled  during  the  field  visits. 

Line  4 indicates  the  percentage  of  total  installs  represented  by  the 
saitple  selected  for  each  aircraft  type.  For  example  - T-38s.  A sample  of 
296  installs  out  of  621  represents  56  percent  of  the  total  T-38  fleet. 

Line  5 indicates  the  percentage  that  each  sanple  (for  each  aircraft 
type)  represents  out  of  the  total  installs  (all  aircraft) . For  example  - 
T-38s. 


Sample  296  (T-38s) 
Total  Fleet  1104 


27  percent 
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SCHEDULE  OF  TRAVEL 


Figure  1 illustrates  the  predicted  travel  requirements,  timing,  and 
individuals  involved  in  the  data  collection  for  the  TACANs.  A total  of  44 
man-days  is  predicted  to  be  spent  in  this  effort. 

5.  ARINC  FIELD  DATA  COLLECTION 

The  field  TACAN  data  will  be  collected  by  ARINC  Research  visits  in 
accordance  with  the  plan  noted  in  Table  2.  The  data  collection  form  and 
elements  to  be  collected  are  shown  in  Figure  2. 

/ 

5.1  Data  Element  Discussion' 

The  following  is  a discussion  of  each  data  element  shown  in  Table  4. 

a.  Aircraft  Type.  Record  the  aircraft  type  for  each  observation. 

These  data  are  required  in  categorizing  statistics  by  given  type, 
e.g.,  trainer,  fighter/attack,  bomber/cargo. 

b.  Aircraft  Tail  Number.  The  tail  number  should  be  recorded  to  help 
identify  installs  that  have  been  previously  read.  The  tail 
nuinber  provides  a quicker  means  of  determining  this  information 
(versus  the  R/T  serial  which  requires  entry  into  the  aircraft) . 

This  will  be  useful  at  bases  visited  by  ARINC  where  all  TACANs 
could  not  be  read  (e.g.,  aircraft  is  on  a mission).  AF  personnel 

i will  later  be  required  to  collect  this  information.  The  tail 

number  will  assist  them  in  identifying  which  planes  still  require 
a reading. 

c.  R/T  Record  Card.  All  installs/remove  information  on  the  R/T 
Record  Card  must  be  recorded.  This  includes  all  removals/ 
reinstalls  due  to  false  pulls  and  similar  reasons.  In  most  cases 
this  information  will  consist  only  of  an  install  date.  On 
occasion,  there  may  be  multiple  entries  (a  false  pull-reinstall). 

In  order  to  account  for  total  usage,  all  information  on  the  TACAN 
R/T  Record  Card  must  be  recorded.  In  situations  where  the  aircraft 
has  experienced  multiple  installs  (due  to  a failure  and  return 

to  the  manufacturer) , previous  TACAN  liistory  will  be  determined 
from  Collins  records. 
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Figure  2.  AN/ARN-118 (V)  TACAN  ETI/INSTALL  COLLECTION  FORM  CPO  F09603-77-A-3104 


d.  R/T  Serial  Number.  The  R/T  serial  number  must  be  recorded  to  pro- 
vide a means  of  tracking  the  specific  equipment  relative  to  Collins 
records. 

e.  ETI  Reading.  The  ETI  reading  must  be  taken  for  each  installed  R/T. 
These  data  will  be  used  in  computation  of  average  operating  time. 

f.  Flying  Hours  at  Install.  Record  the  aircraft  flying  hours  at  the 
time  t install.  These  data  may  be  difficult  to  obtain  unless 
recorded  in  squadron  production  analysis  documents.  This  entry  will 
be  used  with  the  "Flying  Hours  at  Reading"  entry  to  determine  the 
flying  hours  statistics. 

g.  Flying  Hours  at  Reading.  These  entries  will  be  obtained  from 
production  analysis  documents. 

h.  Date  Read.  The  data  of  R/T  ETI  observation  should  be  recorded  in 
order  to  establish  cut-off  points  of  computations. 

i.  Collins  ETI  Reading  at  Ship.  Collins  customarily  "burns  in"  each 
unit  for  approximately  100  hours.  The  ETI  reading  at  Ship 
establishes  initialization  time  for  subsequent  AF  usage.  These 
data  will  be  obtained  from  Collins  logs. 

j . Comments.  Observations  that  might  impact  upon  subsequent  evalua- 
tion should  be  noted.  If  the  aircraft  has  multiple  TACANs  or 
sub-units,  this  observation  would  impact  upon  computation  of  MTBF. 

If  it  is  determined  that  the  install  is  a replacement  for  a 
failure,  this  notation  would  flag  the  need  to  track  the  failure 
using  Collins  data.  The  initial  TACAN  installation  date  for  the 
tail  number  (column  b)  should  be  recorded  here. 

Each  data  sheet  will  be  identified  by  AF  base  and  a carbon  copy  or 
duplicate  prepared.  The  copy  will  be  returned  immediately  to  a central 
file  at  ARINC  Research  for  immediate  processing,  and  to  provide  a back-up 
in  the  event  of  data  loss. 

Data  will  be  collected  for  all  installed  R/Ts  from  date  of  program 
start  (approximately  from  28  December  1975)  up  to  the  time  of  reading. 


6.  AIR  FORCE  DATA  COLLECTION 
6. 1 Background 


The  field  data  collection  noted  previously  will  be  done  at  11  of  the 
29  bases  where  TACANs  are  deployed.  It  is  desired,  however,  to  follow 
through  on  the  data  collection  by  using  USAF  personnel  to: 

• Collect  data  on  bases  not  visited 

• Collect  data  on  installed  TACANs  that  could  not  be  gathered  during 
the  visits.  (e.g. , aircraft  away  from  bases  on  mission) 

As  part  of  the  overall  data  collection  effort,  AFLC/LOM  will  obtain  the 
above  information.  This  effort  will  be  performed  at  the  convenience  of 
the  Air  Force  and  hopefully  will  be  completed  in  time  to  be  included  in 
the  study  analysis  (approximately  end  of  November  1977) . 

6. 2 ETI/Install  Collection  Form 

The  data  elements  to  be  collected  are  shown  in  the  ETI/Install 
Collection  Form  (Table  4) . Copies  of  this  form  will  be  supplied  to  AFLC/ 
LOM  for  use  in  Air  Force  data  collection  efforts. 

a.  Aircraft  Type.  Aircraft  type  for  each  installed  R/T  should  be 
noted.  These  data  are  required  in  categorizing  statistics  by 
aircraft  type  for  the  evaluation. 

b.  Aircraft  Tail  Number.  The  aircraft  tail  number  should  be 
recorded  to  help  identify  installs  that  have  been  read.  The 
tail  number  provides  a quick  visual  rneams  of  determining  this 
information  (versus  the  R/T  serial  which  requires  entry  into 
the  aircraft)  by  the  AF  personnel  who  must  collect  data. 

c.  R/T  Record  Card.  All  install/remove  information  on  the  R/T 
record  card  must  be  recorded.  This  includes  removals/reinstalls 
due  to  false  pulls  and  similar  reasons. 

d.  R/T  Serial  Numbers.  The  serial  number  of  installed  R/Ts  must  be 
recorded.  The  purpose  of  maintaining  the  serial  number  is  to 
provide  a means  for  tracking  specific  equipments  relative  to 
Collins  records. 

In  bases  that  have  been  visited  by  ARINC  Research,  the  USAF  will 
be  provided  with  a list  of  installed  R/T  serials  (by  aircraft  and 
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base)  read  by  the  field  team.  Any  serials  not  on  this  list 
represents  the  balance  of  installed  R/Ts  that  require  reading. 

e.  ETI  Reading.  The  ETI  reading  must  be  taken  for  each  installed  R/T. 

f.  Flying  Hours  at  Install.  Record  the  aircraft  flying  hours  at  the 
time  of  install.  This  entry  should  be  obtained  from  squadron 
analysis  documentation  if  possible. 

g.  Flying  Hours  at  Reading.  Record  the  flying  hours  of  the  aircraft 
at  the  time  of  the  reading.  This  will  be  obtained  from  production 
analysis  documents. 

h.  Date  Read.  The  date  of  the  R/T  ETI  observation  must  be  recorded 
in  order  to  establish  cut-off  points  of  computations. 

i.  Collins  ETI  Reading  at  Ship.  Not  required  from  Air  Force  readings. 
Will  be  obtained,  if  time  permits,  by  ARINC  Research. 

j.  Comments . Notation  should  be  made  of  multiple  TACAN  installs 
within  the  aircraft  or  multiple  sub-units.  The  initial  TACAN 
installation  date  for  the  tail  number  (column  b)  should  be  recorded 
here. 

7.  COLLINS  DATA  COLLECTION 

The  following  data  will  be  collected  from  the  ARN-118 (V)  TACAN  manu- 
facturer for  the  purpose  of  determining  contractual  average  operating  time 
(AOT)  and  mean  time  between  failures.  These  contractual  computations  will 
be  coitpared  to  the  field  operational  data  noted  in  Section  5 of  this  plan. 

7. 1 Data  to  be  Collected,  Sources  and  Applications 

Table  3 outlines  the  type  of  data  required  in  developing  the  contractual 
computations  that  are  available  at  Collins  Radio  Group.  In  addition,  these 
data  will  be  used  for  providing  general  information,  e.g. , unit  serial 
numbers  by  base  for  development  of  field  data  collection  forms. 

These  data  will  be  collected  during  two  visits  to  the  contractor's 
Cedar  Rapids,  Iowa  facility. 

The  first  conference  would  establish  the  study  base? ine  and  provide 
inputs  to  the  field  efforts.  This  trip  would  also  be  ue  1 to  present  the 
purpose  of  the  study  to  CRG  and  gain  the  latter's  support.  The  second 
visit  would  provide  an  opportunity  to  obtain  any  additional  update  informa- 
tion and  discuss  field  observations. 
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Table  3,  COLLINS  DATA  COLLECTION 

Data  Description 

Data  Source 

Application 

Initial  Delivery  Log 

Collins  Log  <1 

* Info  on  each  unit  initially  shipped 

* Contains:  Serial*  shipdate*  destination  BTI 
reading*  mod  status 

* Will  be  used  to  establish  fleet  size*  location 

Subsequent  Delivery  I/^g 

Collins  Log  *2 

* Provides  record  of  every  replacement  unit 
shipped 

* Contains:  Serial*  ship  date*  location  mod 
status*  BTI  reading 

* Por  failed  unit:  Serial,  APR  requesting*  date 
of  request 

* Will  be  used  to  establish  current  AFB  inventory^ 
failure  info 

Corrective  Action  Summary 

Collins  Log  13 

• Provides  a record  of  each  unit  returned  to 

Collins 

• Contains:  failure  location,  repair  and  mod 
actions*  verification*  elapsed  operating  time, 
install  days 

• Will  be  used  to  establish  verified  failures* 
operating  time  and  install  days  for  computation 

Secure  Storage  Population 

Collins  Log  #4 

• Provides  running  status  of  receive  storage 
population 

• Contains  listing  by  unit  type  quantity  on  last 
day  of  month 

• Will  be  used  as  backi^  info 

Unit  Cycle  Time 

Collins  Log  #5 

• Record  of  the  time  required  for  various  segments 

• Contains:  Serial*  ship  date*  installation  date* 
removal  date,  date  shipped  to  Collins 

• Will  be  used  as  backup  info  in  analyses 

Modification  Status 

Collins  Log  «6 

* Record  for  each  unit  by  serial  of  mod  status 

* Will  be  used  as  backup  info  in  ascertaining 
fleet  status 

Modification  Summary 

Matrix 

Collins  Log  #7 

* Shows  what  mod  status  of  each  unit  should  be 

• Will  be  used  as  backup  info  in  ascertaining 
fleet  status 

Warranty  Population 

Collins  Log  #8 

• Produces  a monthly  snapshot  of  the  total  popula- 
tion of  unit  delivered 

* Will  be  used  as  backup  information  in  ascertain- 
ing fleet  status 

Lost , Nonreparable , 

Inactive  Units 

Collins  Log  #9 

* Provides  info  on  data  description  categories 

* Will  be  used  to  adjust  fleet  statistics 

Monthly  R/T  Operating 

Time  Suntnary 

Collins  Log  #10 

• Provides  a record  of  the  number  of  R/T  units 
returned  to  Collins 

* Will  be  used  to  compute  contractual  average 
daily  and  monthly  operating  hours 

Contract  Price  Adjustment 
and  MT6F  Guarantee 
Statistics 

Collins  Log  #11 

• Provides  for  suimnary  of  vital  statistics 

• Will  be  used  as  a cross-check  on  contractual 
computations 

Warranty  Data  Report 

Collins*  June  13th 
report 

* Contains  logs  noted  previously  except  Log  #2* 

10*  11 

* Contains  narrative  and  summary  statistics 

* Will  be  used  as  baseline.  Additions  since 
last  report  will  be  obtained  to  minimize  data 
collection  effort. 

Conferences 

At  CRG*  Cedar 

Rapids 

1 

* Conferences  will  be  used  to  obtain  observations 
other  than  those  documented  above 

Average  Number  of  Installs 
by  Month 


Collins  (provided 
by  AP  to  CRG) 


Used  for  computation  of  Total  Operate  Hours 


7,2  Scope  of  Data 


The  data  outlined  in  Table  3 are  known  to  exist  as  a result  of  CRG 
TACAN  contractual  requirements.  As  a result,  it  is  anticipated  that 
collection  efforts  will  require  minimum  effort  involving  primarily  manual 
update  of  CRG's  April  15th  baseline. 

It  will  be  noted  that  basic  information  such  as  ETI  readings  of 
returned  units,  install  days  and  failures  can  be  found  in  Logs  #3  and  #10. 
Other  logs  provide  useful  information  on  item  status  and  as  a cross  check 
of  field  data. 

For  example: 

Log  #1  helps  in  preparing  serial  number  and  locations  to  which 
units  are  sent. 

Log  #2  helps  establish  replacement  serials  for  failed  units  and 
provides  a cross-check  reference  on  failures. 

Log  #4  could  be  useful  as  a backup  source  in  tracking  deliveries 
(including  replacements) . 

Log  #5  provides  a cross-check  source  for  installation  and  removal 
data. 

Log  #6  could  be  useful  in  tracking  of  returns  - not  of  a failure 
nature. 

Log  #7  could  be  used  in  cross-referencing  information  of  Log  #6, 

Log  #8  will  help  provide  an  insight  into  fleet  status  at  the  time 
of  field  visits. 

Log  #9  will  be  used  to  adjust  fleet  statistics  particularly  for 
serials  which  are  no  longer  in  the  inventory  due  to  aircraft 
crashes. 
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PART  II  - TACAN  DATA  EVALUATION  PLAN 


This  section  describes  how  the  data  collected  in  the  activities 
described  in  Part  I will  be  processed  to  provide  the  information  required 
in  this  study. 

1.  FIELD  DATA  ANALYSIS 
1. 1 Base 

The  data  collected  at  each  base  visited  by  ARINC  Research  will  be 
processed  to  obtain  total  TACAN  operate  hours  at  that  base  and  total 
installed  days  at  that  base.  This  will  be  done  by  summing  the  operate 
times  and  install  days  observed  on  flight  line  R/T  installs  auid  on  R/T 
returns  to  Collins.  This  information  will  provide  a total  for  each  base 
except  for  R/Ts  that: 

• are  in  transit  to  Collins  during  the  measurement  period 

• have  been  removed  at  a base  but  are  packaged  or  otherwise  unavail- 
able for  viewing 

• have  been  exchanged  with  other  bases  not  visited  during  this  effort. 

It  is  expected  that  this  missing  data  will  represent  a small  fraction 
of  the  total  data  for  a base.  However  if  missing  data  appears  to  be  a 
significant  portion  of  base  information  (e.g.,  10  percent  or  more  of  all 
R/Ts  involved)  extra  efforts  will  be  made  to  acquire  it  (e.g. , phone 
Collins  to  request  follow-up  on  in-transit  items;  request  that  packaged 
units  be  opened  for  inspection,  etc.)  or  to  adjust  the  available  data 
accordingly. 


A-16 


Once  compiled,  base  information  will  provide  the  following  estimates: 

a)  TACAN  total  operate  time  (TOT) 

b)  Total  base  TACAN  install  days 

c)  Average  operate  time  (AOT)  per  installed  day  (viz.  a/b) 

d)  When  combined  with  TACAN  return  data  at  Collins,  base  MTBF  (viz. 

TOT  divided  by  the  number  of  failed  units  received  at  Collins) 

e)  Number  of  installed  TACAN  sets  by  month 

1.2  Aircraft  Type 

Information  by  each  aircraft  type,  e.g.,  T-38,  B-52,  etc;  will  be  pooled 
to  provide  estimates  for  each  aircraft.  The  parameters  to  be  calculated 
are  those  shown  in  paragraph  1.1  above. 

1. 3 Generic  Type 

Information  from  attack/fighter  bases,  bomber/cargo  bases,  and 
trainer  bases  will  be  pooled  to  provide  estimates  for  those  classes  of 
aircraft.  The  parameters  to  be  calculated  are  those  shown  in  paragraph 
1.1  above. 

1.4  Sub- population  Esimates 

Information  from  all  bases  visited  during  this  effort  will  be  pooled 
to  provide  sub-population  estimates  of  the  parameters  shown  in  paragraph 
1.1  above.  These  results  will  later  be  compared  with  Collins  statistics 
for  this  sub-population  which  represents  nearly  50  percent  of  the  TACAN 
fleet. 

2.  COLLINS  RADIO  GROUP  DATA  ANALYSIS 

The  Collins  Radio  Group  information  on  TACAN  returns,  ETI  readings. 
Installed  days,  and  Number  of  installs  will  be  reviewed  and  separated 
into  two  classes;  a)  information  related  to  bases  in  our  sub-population 
and  b)  other.  The  information  in  class  a)  will  be  put  into  the  RIW  con- 
tractual formulas  for  AOT,  Total  Operate  Time  (TOT)  eind  MTBF. 

3.  COMPARISON  OF  ACTUAL  AND  CONTRACTUAL  DATA 

The  estimate  of  AOT,  TOT,  and  MTBF  calculated  in  paragraphs  1 and  2 
will  be  coirpared  with  each  other  and  with  similar  con^arisons  with  lOT&E 
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data.  We  will  identify  any  trends  which  appear  anS,  to  the  extent  possible, 
relate  these  trends  in  terms  to  the  size  of  the  TACAN  population,  usage 
patterns,  timeliness  of  failure  or  install  data,  or  other  relevant  factors. 

4.  AIR  FORCE  DATA  COLLECTION 

All  data  supplied  by  Air  Force  sources  at  bases  not  visited  during  this 
effort  will  be  reviewed  by  ARINC  Research  personnel  for  reasonatbleness , 
consistency,  and  completeness.  The  resulting  information  will  be  combined 
with  the  data  collection  logs  conjjleted  during  our  own  efforts  and  will  be 
provided  as  a deliverable  item  for  this  contract. 

As  time  and  resources  of  this  effort  permit.  Air  Force  supplied  data 
will  be  processed  to  provide  estimates  such  as  those  shown  in  paragraph 
1.1.  If  these  data  are  of  sufficient  quality,  it  may  be  possible  to  make 
actual  vs.  contractual  comparisons  for  an  "expanded"  sub-population,  viz. 
the  ARINC  visited  bases  plus  other  bases  which  have  Air  Force  supplied 
information.  If  such  analysis  is  possible,  care  will  be  taken  to  identify 
the  results  associated  with  each  sub-population. 

5.  TACAN  FLEET  OBSERVATION 

The  final  report  for  this  investigation  will  address  any  problem  or 
observations  that  have  come  to  out  attention  during  base  visits.  Areas 
of  attention  include  installation,  material  and  record  flow,  and 
maintenance  usage  or  other  features  that  may  influence  the  field  per- 
formance of  TACAN  as  it  was  reviewed  by  this  study. 


PART  III  - IMPACT  OF  ANALYSIS 


The  results  of  this  study  will  be  used  to  assess  possible  impacts 
in  the  TACAN  contract.  The  two  such  areas  to  be  discussed  are  as  follows: 

1.  PRICE  ADJUSTMENT 

Since  the  utilization  of  the  TACAN  is  based  on  a tolerance  of  ±5  percent, 
any  variation  from  that  value  as  discovered  through  this  study  will  reflect 
itself  in  a price  adjustment  based  on  the  actual  operating  hours.  This 
study  will  project  the  possible  magnitude  of  that  adjustment  should  it  be 
necessary. 

2 . MTBF  GUARANTEE 

As  it  is  contractually  stipulated,  the  progress  of  the  TACAN  towards 
its  growth  goals  will  be  monitored  by  the  Government.  Based  on  the  data 
presented  in  the  study,  the  actual  MTBF  of  the  TACAN  will  be  estimated, 
and  its  ramifications  discussed. 
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Flying  Hours 
(10)  (11) 

411.3 

403.2 

277.3 
411.0 

411.0 

373.2 

218.6 

207.4 

301.8 

308.4 

181.8 

239.0 

355.2 

408.2 
338.6 
136.9 

403.3 

213.2 

277  6 

290.3 

Flying 

Hours 

At 

Install 

6100.3 

14145.0 

12880.0 

9834.0 

14500.0 

2666.7 

2160.5 

2350.0 

2220.5 

14540.0 

9424.5 

2085.6 
14600.2 

13320.0 

12718.0 

12115.0 

9670.0 

2250.0 

2290.0 

2120.0 

12620.0 

Flying 

Hours 

At 

Read 

6511.3 

14548.2 

13157.3 
10245.0 

14873.2 

2885.3 

2367.9 

2651.8 

18379.5 

14848.4 

9606.3 

2324.6 

14955.2 

13728.2 

13056.6 
12251.9 

10073.3 

2250.0 

2503.2 

2397.6 

12910.3 

A 

Install  Days 
(7)  - (8) 

IJ 

Mo-Day-Yr 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

R/T  Racord  Card 
Date 

Mn-rtaw-Vr 

1 

1 1 1 1 1 1 t 1 1 1 1 ) 1 1 1 1 1 1 1 1 1 t 1 ( 1 1 1 1 1 ><  < 

Install 

8/29/77 

3/31/77 

3/29/77 

3/28/77 

4/6/77 

4/6/77 

3/31/77 

5/16/77 

5/16/77 

6/21/77 

7/25/77 

5/27/77 

5/27/77 

8/8/77 

8/8/77 

4/4/77 

5/12/77 

5/12/77 

6/16/77 

6/16/77 

4/5/77 

3/25/77 

3/30/77 

5/5/77 

2/5/77 

5/9/77 

5/9/77 

5/25/77 

5/25/77 

5/16/77 

5/16/77 

3/28/77 
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h 

<N^O>0'HfNOl^®®vOr**r^'^vOvOU^»^'Hr'00<NinOOCNCDm<^OOdCO 
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Hours 

<1 
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ETI 
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■1 
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Number 

ino®CNmpompH®®Of'»«H<N<NrHf>ir»'^®r'»®®®^r»r«®®®rHr» 

f^OOWl/>®r*»49'®VP^»HfHr*“®f'llO®H<r*49'®CN^fO»-IU1'H®^®® 

Aircraft 
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Number 

0949 

7888 
7836 
7823 

7889 
1298 

1590 

1587 

1586 

7892 

7839 

1588 

7882 

7790 

7786 

1821 

0538 

1585 

1583 

1581 

7793 

Aircraft 

i. 

>> 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

1l 


< 

a 


tc 

< 


I 


I 

u. 

3 


Commants 

Mock-Up 

e 

g 

> 

tk 

(10)  (11) 

304.6 

297.8 

505.7 
350.6 

250.9 

351.8 

351.8 

231.8 

309.5 

279.0 

411.8 

261.9 

287.6 

365.9 

407.7 

196.8 

200.0 

179.8 

Flying 

Hours 

At 

Install 

9575.0 

10395.8 

15609.0 

13930.0 

2000.0 

10200.0 
10200.0 

2156.1 

2180.0 

10150.0 

10434.0 

2200.0 

2902.5 

2815.0 

11657.0 

2240.0 

12539.0 

12430.0 

Flying 

Hours 

At 

Read 

9879.6 

10395.8 

16114.7 

14280.6 

2250.9 

10551.8 

10551.8 

2387.9 

2489.5 

10429.0 

10845.8 

2461.9 

3190.1 

3180.9 

12064.7 

2436.8 

12739.0 

12609.8 

— 
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3»2<NC400i-»fH»-*rHC>i<N»nmff'C'00  i \Ovomf>jf'ifsOOMCNf>»r>»(y'<N 

1 
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10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 

10/19/77 



— 

R/T  Racord  Card 
Date 

Mo-Day-Yr 

Ramova 

1 1 1 1 1 1 1 1 < 1 ((  1 1 1 1 1 1 1 1 I 1 1 1 1 t I 1 1 1 ( 1 1 

Install 

5/5/77 

5/5/77 

6/17/77 

6/17/77 

3/31/77 

3/31/77 

6/24/77 

6/24/77 

3/24/77 

3/24/77 

6/16/77 

6/16/77 

5/20/77 

5/20/77 

4/5/77 

4/5/77 

3/29/77 

3/29/77 

5/11/77 

5/11/77 

8/28/77 

6/20/77 

6/16/77 

6/16/77 

3/28/77 

3/28/77 
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6/20/77 

7/21/77 
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9813 

9814 

1594 

0530 

1595 

1597 

0526 

0535 

NA 

1580 

1292 

1291 

7887 

1582 

9817 

7765 
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C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

M 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

C-130 

B-14 


AN/ARN-118(V)  TACAN  FIELD  DATA 

Air  Forea  B«a  Little  Rock  AFB,  AR  CPO  F09603-77-A-3104 
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APPENDIX  C 


BASIC  CONTRACTOR  DATA 
(COLLINS  AVIONICS  GROUP) 
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APPENDIX  D 


BASIC  USAF  SUBMITTED  DATA 
AND 

PRELIMINARY  CALCULATIONS 


PREPARED  BY 
ARINC  RESEARCH 


INCLUDES  DATA  FROM 

ANDERSEN  AFB 
BARKSDALE  AFB 
BLYTHEVILLE  AFB 
COLUMBUS  AFB 
DYESS  AFB 
EDWARDS  AFB 
EGLIN  AFB 
FAIRCHILD  AFB 
GRAND  FORKS  AFB 
K.I.  SAWYER  AFB 
MINOT  AFB 
NELLIS  AFB 
UPPER  HEYFORD  AFB 
VANCE  AFB 
WILLIAMS  AFB 
WURTSMITH  AFB 
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